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CHAPTER I; INTRODUCTION 



PURPOSE 



In the Court Order of September 1981, the Superior Court ordered the Los 
Angeles Uuiried School District to provide "...on or before July 15^ 1983, 
a full report of the measures taken and results achieved under its (student 
integration) Plan..." As part of the Student Integration Plan, programs 
have been developed for schools that are predominantly (70%) Hispanic, 
Black, Asian and other Non-Anglo (PHBAO). m response to the Court Order, 
this report serves as one piece of the evaluation of the PHBAO programs. 
The evaluation is based on data collected from school staff, students and 
parents during the 1982-83 school, year. 

BACKGROUND OF PHBAO PROGRAMS 

On October 3, 1977, the Los Angeles Unified School District submitted to 
the Superior Court their student integration plan. Integrated Educational 
Excellence Through Choice . While acknowledging the negative consequences 
of segregation, the student ijitegration plan excluded some 256,000 stjidents 
who attended racially isolated minoritii' schools, in response to the District 
plan, Superior Court Judge Egly requested that the District specify the 
efforts which would be made to alleviate the consequences of segregation. 
The Court also identified the following four ameliorants to the harms of - 
racial isolation: 

" Improvement in the self-esteem, aspirations and other 
personality-related dispositions of minority children; 
Improvement in academic achievement; 

« Reduction in interracial hostility and the elimination 
of racial intolerance; and 

Increased access to educational resources and to post- 
secondary education opportunities. 

In November 1977, the District identified seven types of assistance which 
would be provided to improve the quality of the racially isolated minority 
schools. In an attempt to prioritize the types of assistance to be made 
available by the District, the Integration Planning and Management Office 
conducted a survey of 219 ptincipals in racially isolated minority schools 
in the Fall of 1978. The principals ranked the needs of these schools as 
follows: improved teacher quality, improved curriculum, reduced enrollment, 
iinproved housing, increased parental participation, preschool education and 
year-round schools. 

During the Spring of 1979, thirteen programs were developed to help meet 
the heeds of racially isolated minority schools as identified above. m 
August 1979, Judge Egly issued the Minute Order Respecting Temporary 
Implementation of RiMS Component which required LAUSD to implement the RiMS 
program in 218 schools during the 1979^80 school year. During the 1980-81 
school year, the number of schools in the program expanded to 264 and the 
number of programs increased to 16. . 
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In 1981, the number of schools increased to 298 and the number of programs 
increased tp 21 (programs are listed in Appendix A). A major change in the 
conceptualization of the program occurred in September 1981, when the 
Superior Court ordered LAUSD "...to end the use of terminology classifying 
Black, Hispanic, and Asian children as well as those of other non-Anglo 
ancestries as minority children..." since these children .comprise the 
vast majority of the school population.^' Required by the Superior Court to 
substitute a neutral term for the previously designated racially isolated 
minority schools and students, the District adopted the terms PHBAO 
(Predominantly Hispanic, Black, Asian and Other Non-Anglo) students, PHBAO 
schools, and PHBAO programs. 



EVALUATION DESIGN 

The 1982-83 e'Tluation for those schools that are predominantly (70%) 
Hispanic, Black, Asian and Otner Non-Anglo (^HBAO) consisted of four 
analytic approaches: a harms analysis, an implementation analysis, an 
effectiveness analysis, and an analysis of achievement and attitude data. 
These four analyses are summarized briefly below. 

1 . Harms Aiialysi s 

This analysis examined the progress made by the Los Angeles Unified School 
District in reducing the four "harms of racial isolation." As indicated 
earlier, these include low achievement, low self-esteem; interracial 
intolerance and hostility, and limited access to pos trsecondary opportunities 
In order to ascertain such progress, the following procedures were used: 

1 . High and low scoring schools were selected for each of the four 

harms, (e.g., schools that score higher on self-esteem and schools 
that score lower on self-esteem). Determinations of scoring status 
were based on existing and newly collected data. 

2. A sample of PHBAO schools which share a common constellation of 
programs was selectee*. 

3. AS appropriate, staff, parent, and student data were collected to 
determine which particular practice(s) related to high- and low- 
outcomes on the "harm" variables. 

Conceptually, this approach represented a significant departure from prior 
PHBAO evaluations. TJie schools, rather than the individual programs, were 
the unit of analysis.' Hence, there was no attempt to relate individual 
PHBAO programs to progress with regard to specific harms. Similarly, there 
was no effort to make casual statements concerning specific programs and 
outcomes . 



-2- 



9 



2 . Implementation Analysis ' 

A second focus of the 1982-83 evaluation involved collecting implementation 
data about seven programs as requested by the District's Office of Student 
Integration Options and the Office of Compliance - Integration. These 
seven programs are Computer Assistance, Curriculum Alignment, Project 
Textbooks, Student-to-Student Interaction, Supplemental Counseling, Urban 
Classroom Teacher Program, and Bilingual Classroom Teacher Program. The 
emphasis of this aspect of the evaluation was to (1) determine whether tY.^ 
seven programs were in place, and (2) identify the implementation strategies 
associated with staff/parent perceptions of outcomes. 

3 • Effectiveness Analysis ; ^ 

A third focus was the survey of perceived effectiveness of all programs. 
Year-Round schools and non-Year-Round schools were compared for 19 programs. 
The programs are: (1) Computer Assistance, (2) Curriculum Alignment, (3) 
Project Textbooks, (4) Student-to-Student interaction, (5) Supplemental 
Counseling, (6) Bilingual Classroom Teacher Program, (7) Urban Classroom 
Teacher Program, (8) Administrative Development Program, (9) Selection of 
Department Chaixjperson , (10) Leadership Team Program, (11) Staff Development, ^ 
(12) Language Acquisition,. (13) Class Size Reduction, (14) Instructional 
Adviser Program, (15) Maintenance/Alteration/Xmprovement Program, (16) 
Project AHEAD, (17) Extension of the Primary School Day, (18) Articulation, 
and {19) Parent-Teacher Conference Program. 

4 • Ai.alysis of Achievement and Attitude Dat a 

Achievement and attitude '.ata were collected in the Spring of 1983 as part 
of the District testing program. Elementary and secondary achievement was 
measured by the Survey of Essential Skills (SES) and the Comprehensive Test 
of Basic Skills (CTBS), respectively. 

The 1982-83 achievement test data were analyzed from five perspectives: 

1. Analysis in relation to norms - the spring, 1983 PHBAO test results 
were compared with relevant standards (i.e., at the elemented ry level. 
District standards for the SES; at the secondary level, national 
norms for the CTBS ) . \ 

2. Analysis over time - the spring, 1983 scores were compared with. the 
spring, 1981 and the spring, 1982 scores for those schools in the 
program tor tnree or more years""and with the spring, 1982 scores 
for those schools in the program for two years . 

3. Analysis by length of program impleiaeatation - the spring, 1983 
y scores for schools in the program three or more years werr^; com- ^ 
^ pared with the 1983 scores for schools in the program for two years. 

4. Analysis by type of teacher program - a comparison of the spring, 
1983 test scores of those schools participating in the Urban Class- 
room Teacher Program and those in the Bilingual Classroom Teacher 
Program was made. Using the same UCTP and BCTP dichotomy, compari- 
sons of scores over time and by length of program implementation 
were developed. 



ERIC 



5. Analysis of school schedule - a comparison was made of year-round 
and non-year-round schools. 

The full range of comparisons (i.e., items 1 through 5, above) will cover 
elementary schools. The range is somewbat restricted at the secondary 
level given the lesser variation in length of program implementation and 
school schedules. 

The 1982-83 attitude data were analyzed from three perspectives: 

1. Analysis in relation to norms - the 1982-83 SAM test results were 
compared with national norms as well as District norms. 

2. Analysis over time - the 1982-83 SAM scores were contrasted with 
the SAM scores obtained during the 1980-81 and 1981-82 academic 

^ years. These contrasts were made in relation to national 

standardization samples. 

3. Analysis by school schedule - the above two analyses were conducted 
for the non-year -round schools as well as the year-round schools. 

In keeping with the analytic approaches presented above, the 1982-83 PHBAO 
evaluation objectives were: 

1 . To identify those general educational practices and procedures 
that are related to each of the four "harms of jacial isolation," 
(i.e., "low achievement, low self-esteem, interracial intolerance * 
and hostility, and limited access to post-secondary opportunities). 

2. To identify particular educational practices and strategies that 
are related to high- and low-outcomes on the "harm" variables. 

3. To collect and document pertinent implementation and outcome data 
for seven designated programs. 



To 



ascertain the overall effectiveness of all programs. 



5. To compare year-round and non-year-round schools^ in terms of per- 
ceived program effectiveness, student achievement/ and student 
self-esteem- 

Data Collection - - — 

Data collection took place from February - May, 1983. All schediiling and 
data collection activities were conducted by trained PHBAO, Advisors and 
were coordinated by the Research and Evaluation. Branch "s PHBAO Evaluation 
Unit. \ ^ 

\ . • ■ 
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For the four types of analyses described above, data collection included 
inte^rviews, questionnaires, record reviews and observations* Reapond.ents 
varied by analysis, but generally included school staff (principals and 
teachers), students and parents. 

Procedures, instruments and sample are described separately for each 
evaluation component. 
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CHAPTER II; PROGRAM IMPLEMENTATION 



BILINGUAL CLASSROOM TEACHER PROGRAM 

PROGRAM .DESCRIPTION 

The Bilingual Classroom Teacher Program (BCTP) was developed to meet the 
needs of the national origin minority students who are required by state 
mandate (AB 1329) to participate in the Los Angeles unified School District 3 
Lau Plan. The intent of the BCTP is to (1) provide^ salary incentives to 
recruit and retain bilingual teachers at specific program locatio^ns, and 
(2) improve the language services offered tp Limited-English-Prof icient 
(LEP) Students. / 

The general goal of the BCTP is to have qualified bilingual teachers, i.e., 
those who meet credential or .certification and fluency requirements, agree 
to perform additional assigned duties and responsibilities for two and 
one-half hours each week. The assumption is that these additional responsi- 
bilities will improve teacher quality by upgrading the curriculum, instruc- ^ 
tion, and services given to LEP students. 

The BCTP developers believed that to achieve this goal, teacners and eligi- 
ble support staff who possess an appropriate bilingual ci-dential or a 
certificate and who are assigned to an approved Lau progrc.:v. school, would 
receive a salary differential amounting to $2,000 per school year. In 
addition, those teachers and eligible support staff whom the District had 
identified as having A-level fluency in a language of need, would receive a 
differential of $1,000 per school year. All contract bilingual teachers 
and staff^'who possess at least one of the following qualifications could 
apply for the BCTP: (1) Bilingual/Cross-Cultural Specialist Credential;. 

(2) Multiple-Subject Credential with Bilingual/Cross-Cultural Emphasis; 

(3) Single-Subject Credential with Bilingual/Cross-Cultural Emphasis; 

(4) Bilingual Certificate of Competence; (5) Emergency Bilingual/Cross- 
Cultural credential; and (6) A-Level Fluency on a District Examination. 

Principals at schools participating in the BCTP are responsible for assess- 
ing the needs of their schools, and for developing goals and objectives for 
their particular BCTP. In turn,' by signing a written commitment form each 
BCTP participant is required to develop and implement an educational pro- 
gram that is designed to meet the desired goals and objectives of the 
particular school. The proposed programs must (1) be approved by the 
principal as functional and promoting the improvement of curriculum, 
instruction, and services to students, (2) involve\a specific number of 
pupils, and (3) be carried out on a regularly scheduled basis. 

• » - - ' " i _ . • ■ 

METHODOLOGY i * 

Sample ^-^^ v / 

.-*•' 

A total of 178 elementary (n=154), junior high (n=15), and senidr high 
(n-9) PHBAO Program schools participated in the 19.82-83 BCTP. f-rom these 
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eligible schools, 15 were selected ^or the program's evaluation. Included" 
were five elementary, five junior high, and five senior high schools. The, 
elementary and junior high schools comprising the school sample were ran- 
domly selected from the District's eight administrative regions, and the 
senior high schools from the District's Senior High School Division. 
Year-round schools were not included in the school sample . 

From the 15 sample schools, 40 teachers were randomly selected from each of 
the three academic levels, i.e., elementary, junior high, and senior high. 
From the lower elementary level, kindergarten through second grade, five 
teachers were chosen; from middle elementary, grades three and four, four 
teachers; and from upper elementary, grades five and six, four teachers 
were selected. B'ourteen junior high and 13 senior high teachers were also 
chosen. A representative sample was selected from tive three grades at the 
junior high level and from the .three at the senior high level. In all, 
13 elementary, 14 junior high, and 13 senior high school teachers were 
included in the teacher sample. 

In addition to the teacher respondents, there were 15 school administrators* 
All were principals, one from each sample school. Hence, a total of 15 prin- 
cipals comprised the principal sample and 40 teachers comprised the teacher 
sample for the 1982-83 BCTP evaluation. 



Instruments 

A structured interview format was the assessment procedure used to gather 
information for the BCTP evaluation. Two such instruments were developed. 
The first was a 28-item inventory designed especially for the principals. 
A 22-item structured interview format was used to solicit feedback from the 
teacher respondents .= Both instruments contained forced-choice type items 
as well as open-ended items. 

Data Collection Procedures 

All of the teachers and principals participating in, .the BCTP evaluation were 
interviewed by a st^ff member of the Los Angeles Unified School District's 
PHBAO Program evaliifition Unit. Individual interviews were held at the home- 
school of each respbndent where each was individually interviewed. in 
gathering feedback from the respondents, care was taken to maintain their 
anonymity, and all were informed that their responses would be treated 
confidentially and would be reviewed only by the PHBAO program evaluation staff. 



SUMMARY AND RECOMMENDATIONS 

The discussion of the findings is organi.'^ed according to the three foci of 
the BCTP evaluation, i.e., the program's impact with regard to the improve- 
ment of language services provided to Limited-English-Proficient (LEP) 
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students, the recruitment and retention of bilingual teachers, and the 
program's implementation at the various PHBAO schools. 

improvement of Language Services 

In relation to the program's first goal, the two respondent groups gave 
differing views when questioned about the BCTP's impact on providing Ian- 
quage services for LEP students. For example, only 55% of the teachers and 
40% of the principals agreed with the assertion that "the non-English-curric- 
ulum taught by their school's BCTP staff had improved as a result of the 
program's implementation." It was surprising to learn, however, that these 
same respondents gave extremely positive ratings to their BCTP teachers 
with regard to their overall teaching effectiveness . There were also mixed 
opinions regarding the non-English instructional materials used at the 
PHBAO sample schools. A third of the ^teachers (32%) and as m.any as two- 
thirds of the principals (67%) were uncertain about the quality and the 
impact of these instructional materials with LEP students. 

The two respondent groups were also questioned about the overall impact of 
the BCTP at their respective schools. Clearly, improved student achievement 
and better student/teacher interaction were the two aspects the respondents 
believed were most influenced by the BCTP. However, the two respondent, 
groups did not agree that the quality of instruction given to LEP students 
had improved as a result of the school's BCTP, A definite majority of 
the teachers felt the BCTP had improved the quality of instruction, but 
only 47% of the administrators agreed with this position. 

The respondents also provided the interviewer with open-ended responses 
focusing on the imoact made by the BCTP at their respective schools, 
several trends are worth noting. -First, the elementary teachers were most 
pleased with the educational gains made as a result of the BCTP ' s teachers 
additional work assignment. They were of the opinion that more time allowed 
them to work individually with students which resulted in improvements in 
students' self-confidence and achievement level, and increased motivation 
for students to attend school on a regular basis. The secondary teachers, 
on the other hand, believed that improved parent involvement, added support 
services, and enhanced student/teacher communication were the by-products 
of the BCTP. These junior and senior high teachers also felt their school s 
social climates and ethnic/cultural awareness had increased as a result of 
the BCTP. 

All agreed the immediate payoffs of the BCTP were (1) getting students to 
achieve at grade level, (2) ameliorating LEP students' apprehensiveness 
• concerning th«ir academic endeavors, and (3) assisting bilingual students in 
'cheir quest for language and cultural acceptance. However, the teachers 
and principals thought the program's primary goal, which is to upgrade LEP 
students'. Englisn language proficiency, would only be realized on a long- 
term basis. 
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Recruitment and Retention 



The BCTP's second primary goal, improved recruitment and retention of 
bilingual teachers, was viewed. quite differently by the principals and 
teachers in the evaluation sample. Only one-third of the administrators 
(33%) responded "yes" when asked if the BCTP was helpful in re cruiting 
bilingual teachers. Forty percent of the teachers agreed. A larger , 
percentage of the administrators (60%) were of the opinion that the BCTP 
had a positive effect in retaining bilingual teachers. Of the teachers 
sampled, 70% agreed. What was clear was that the BCTP made a greater impact 
on retaining rather than on recruiting bilingual teachers at PHBAO schools* 

With regard to the recruitment issue, all of the respondents agreed that 
bilingual staffs are recruited either by direct or by indirect means. Direct 
procedures involve activities such as being asked by one's principal, 
receiving a request from the District central office, or being coerced by 
school administrators. Indirect procedures include dissieminating program 
information at faculty meetings, distributing flyers and bulletins from the 
district office, and communicating by word-of -mouth • 

Related to the recruitment issue was the finding that two-thirds of the 
principals and half of^^he teachers sampled believed a match existed between 
the number of BCTP staff at their school and their school's bilingual needs. 
The comments proffered by the respondents disagreeing with this assertion 
were three. They, were (1) there are far too many students who are in need 
of bilingual services? (2) there are not enough bilingual teachers to 
service basic subject areas such as social studies? and (3) there are too 
few bilingual teachers for certain language groups such as the Cambodian 
and the Vietnamese. 

Once teachers are recruited for the BCTP, what factors operate in determining 
whether teachers remain with the program? The first is the salary differential 
given to BCTP participants. From this evaluation it was learned that 
slightly over half of the teachers (58%) and slightly less than half of the 
administrators (48%) judged the amount of the differential as adequate. 
Second, in relation^ to the morale issue — the morale of BCTP and non-BCTP 
teachers — there was a tendency for both the teachers and principals to give 
positive ratings to the effect of the BCTP on the morale of BCTP teachers. 

They differed in their opinions, hoi-^ever, concerning the morale of non-BCTP 
teachers. The majority of the administrators (86%) believed the BCTP had 
"no effect" on the non-BCTP teachers' morale, while only 48% of the teachers 
in the sample concurred. In general, however, both respondent groups were 
favorable concerning the BCTP ' s helpfulness in retaining bilingual teachers 
at PHBAO schools. 

Program Implementation 

The third component of the BCTP evaluation, determining how the program was 
implemented, irccultcd in several interesting findings. The first dealt 
with whether adequate information about the' nature and implementation of 
the BCTP was provided by the District office. Two-thirds of the teachers 
(67%) responded "yes;." The need for there to be information disseminated 



from the District office rather than from only the local school, the need 
for there to be adequate information about the work duties of BCTP teachers 
and about the program, and the need for the establishment of a more efficient 
District office were three of the most frequently mentioned comments coming 
from those who were displeased with the information received about the BCTP. 

Another implementati.on issue related to the two and one-half hours work 
assignment. The majority of the teachers (70%) and principals (67%) believed 
the BCTP staffs at their respective schools effectively used the work 
assignment time. Also,, there were a variety of activities implemented 
during this time period. However, tutoring/ counseling, and parent contact 
were by far the' most valued. "Also, it was found from this evaluation that 
the procedures used to monitor the various BCTPs varied from school to 
school. And, some BCTPs were monitored, others were not. 

Another intent of thrs evaluation was to ascertain what transpires during 
the needs assessmenc phase of the BCTP. Surprisingly, it was found that 
there were as many different procedures used to complete a school's needs 
assessment as there were pfincipals in the sample. In addition, some 
administrators were e^/rtively involved in this assessment phase while others 
were not. ' Hence, .t-cnere were principals in the sample who knew a great 
deal aibcut .tl/feir school's bilingual needs and whether these needs were 
udaressed by the BCTP. Other principals knew little or nothing about their ^ 
school's needs and even less about their school's BCTP. 

in keeping with the findings of this evaluation, the following recommendations 
are considered of highest import: 

1. That the District engage in public relations activities designed to 
provide greater visibility of the BCTP. 

2. That there be regularly r?cheduled meetings for personnel to exchange 
information and ideas regarding such matters as successful instructional 
activities that can be implemented by bilingual classroom teachers. 

3. That there be made available a greater surplus of non-English instructional 
material and textbooks. 

4. That there be time allotted for the preparation of non-English instruc- 
tional material. 

5. That there be established a non-English curriculum library where 
teachers can secure needed materials. 

6. That there be established a formalized procedure for principals to use 
in the implementation of their school's bilingual needs assessment. 

7. That the District establish on-site observations to oversee the monitoring 
procedures used by individual BCTP schools. ^ 

8. That there be a serious attempt to increase the number of bilingual 
teachers for specific subject matter courses and for specif ic^ language 
groups . * ^17"^ 
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That there be a serious attempt to increase the salary differential for 
BCTP staff. , 



10» That all staff, both teaching and non-teaching, receive intensive inservice 
regarding the goals and purposes o the District's two bilingual programs, 
tii'i Bilingual Classroom Teacher Pro^i.am and the Bilingual Program. 

URBAN CLASSRCXDM TEACHER PROGRAM 



PROGRAM DESCRIPTION 

The Urban Classroom Teacher Program (UCTP) has the following goals: to 
recruit and retain teaching staff, to improve teacher quality, and to provide 
students with additional services such ^s student interest clubs and additional 
school tutoring. Teachers in the 120 schools with the program receive r. 
lump sum differential (salary increment) and assume curricular and extra- 
curricular responsibilities for an additional 2.5 hours a week. . 



METHODOLOGY 

This aspect of the evaluation addressed both implementation and progress 
issues. Implementation issues included procedures for obtaining teacher 
participation, procedures for identifying school needs., and payroll pro- 
cedures. We also assessed staff perceptions of programmatic progress in 
improving teacher stability and providing additional student services. 
Finally, we obtained staff perceptions about morale and the lump sum differ- 
ential. These issues, were addressed through structured interviews with 
staff in 20 UCTP schools. 

Table 1 presents the school sample by category and school level. The total 
sample consists of nine groups. 



Table 1 



Urban Classroom Teacher Program 
School Sample by Category and School Level 



Category 

School Level I II ■ m 

Elementary 6 3 3 

Junior High 2 11 

Senior High 2 1 1 



Schools were sampled randomly within categories with the caveat that 1982 
test data were available for each of them.^ The larger sample of elementary 
schools reflects the fact_that- -there-are moire elementary than junior or 
senior UCTP schools. The larger number of Category I schools in relation 
to Categories ll and III reflects an effort to obtain data about Catagories 
II and III despite the fact that they will be discontinued by the Fall of 1983. 

At each school, interviews were conducted with the principal and 4 randomly 
selected academic curriculum teachers. As appropriate, we also interviewed 
non-signers and Bilingual Classroom Teacher Program teachers. Table 2 
presents the respondent sample. 



Table 2 



Urban Classroom Teacher program 
Respondents by Type, Category, and School Level 



Category/School Level 



Respondent Type 



I 

J 



II 
E J 



III 
E J 



Principal 
UCTP Te^ichers 
Non-Par ticipiints 
BCTP Teachers 



6 2 
24 8 



0 
0 



0 
0 



2 
8 
0 
0 



3 1 

12 4 

1 2 

6 1 



1 
4 
0 
1 



3 
12 
1 
2 



1 1 
4 4 
0 0 

2 1 



The respondent sample totaled 118: 20 principals, 80 UCTP teachers; 5 non- 
participants and 13 bilingual teachers. 

• ^ SUMMARY AND RECOMMENDATIONS 

Our evaluation of the UCTP suggests that the program is progressing quite 
well, both procedurally and in terms of its overall goals. Across the 
board, school staff responded positively procedures for obtaining teacher 
commitments, procedures for assessing school needs, and payroll procedures. 
Teacher dissatisfaction was expressed in two related areas:" (a) compensation , 
in relationship to the actual amount of extra time spent, and (b) differences 
in compensation among the three UCTP categories. Dissatisfaction with the 
lump sum differential was most pronounced for Category III staff. 

Programmatically, the staff view the UCTP in a positive way. Tutoring and 
the special interest clubs are the two activities most frequently undertaken, 
and teachers report that tutoring is the single most beneficial activity 
provided. • Teachers report that tutoring is provided consistently and that 
it is of good quality. ^ 
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Activities related to school staff stability were not rated very highly. 
In particular, recruitment at the senior high level was not viewed as very 
effective/ and teacher absenteeism was judged to be about the same as before 
the program began. 

However, the overall quality of teaching staff was perceived to be somewhat 
improved, and teachers felt the staff au their schools were "more committed" 
than in the past. Similarly, most teachers felt the quality of education 
had been improved "somewhat" to "very much". 

Teachers felt the program •s most important aspect was the extra time they 
were able to spend withi students. Suggestions for improvement included 
(a) increasing the salary differential, and (b) eliminating category 
distinctions. 

Recommendations 

1. That consideration be given to increasing the salary differential. 

2. ' That, category distinctions be eliminated. 

3. That more effective methods be devised for recruiting and retaining 
staff. 

4. That methods be developed for reducing teacher, absenteeism. 
COMPUTER ASSISTANCE 



PROGRAM DESCRIPTION 

The Computer Assistance Program supports the utilization of hardware (computer 
equipment) and software (computer programs/systems) in 20 schools, located in 
high transciency areas. The two available systems are:- 1) the Student 
Data System (SDS) including student identification (ID), class lists, and report 
generating capacity, and 2) the Computer Managed Instruction (CMI) — Reading^ 
LAUSD. utilization of these systems is laimed at reducing record-keeping' 
tasks related to scheduling, placement, and grading students and at facilitating 
instruction specific to identified student needs* 



METHODOLOGY 

Sample 

Respondents from all 20 target schools were involved in the study. Psing a 
purposive sampling method, all principals, computer assistance coordinators, 
and 4th and 6th grade teachers from each of these schools were part of 
the sample. 



Data Collection Procedures 



o 



Questionnaires were distributed to the principals and teachers in the 
sample. Twenty were retrieved from the principals and 101 from the teachers, 
representing a 100% return rate for both groups. Somi -structured interviews 
were held with each of the 20 computer assistance coordinators. 

SUMMARY AND RECOMMENDATIONS 

Over-all, this program is operating quite well, though perhaps somewhat 
unevenly within the target schools. The unevenness can easily be attributed 
to the newness of some of the software and the expected consequences of 
inexperience . a The, benefits of the program are differentially viewed by 
administrators and teachers. Principals look to the SDS to facilitate 
meeting report requirements and general school management in addition to 
the CMI which they view as enhancing the instructional base at the school. 
Teachers look almost exclusively to the CMI as the output is more germane to 
their tasks. A salient finding is the positive regard with which all 
V, involved hold the assistance received* from district staff and outside 
consultants in the operation of this program. 

It is recommended that: 

1 . the program continue to be a priority for the target schools 

2. ' the programs within the sub-systems be expanded to include other 

student data, , such as at^tendance and instructional packages for other 
subjects in addition to reading * 

3. that in future planning, consideration be given to the development 
of in-house programming capabilities so that system capacity can 

be, adapted quickly and easily to the particular needs of each school ' 

4. that in-service focused on^computer capabilities continue 

5. that future planning include teacher training in the direct use of 
the computer so that they can input and retrieve information for their 
teaching purposes and thereby gain a greater appreciation for the 
support that the system can be to their teaching tasks. 



CURRICULUM ALIGNMENT 



PROGRAM DESCRIPTION 

The Curriculum Alignment Project focuses instruction on essential grade- 
level skills.i The alignment of teaching objectives, instruction, and 
assessment is accomplished through instructional planning that involves 
five steps: 1) review of grade-level objectives established by the District, 
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2) setting instructional prioritises, 3) planning instruction, 4) checking 
student progress,; and 5) acknowledging accomplishments. Using a trainer-of- 
traiiiers approach;, District, Region, and school-level personnel, along w? th 
SWRL (program developers) consultants assist teachers in 1) matching their 
classroom instruction with the District-defined essential skills for reading, 
mathematics, and written composition and 2) matching the time required for 
what needs to be taught with the time actually available for instruction. 
There were ten elementary schools involved in the program during 1980-81. 
This number was expanded to 81 during the 1981-82 school year; and presently 
(1982-83) all 238 PHBAO elementary schools are. a part of the project. 



METHODOLOGY 

Sample 

Ten of the elementary Directors of Instruction (two Regions had two respondents) 
were included in the sample. By a mixture of /jpurposive and stratified random 
methods, a sample of 12 schools was chosen to'' include six schools with program 
experience since 1980-81 and six wi th experience since' 1981-82. The Curriculum 
Alignment Coordinator from each of the 12 schools were part of the respondent 
sample as were all 3rd through 6th grade teachers at each of the schools. 

I 

Data Collection Procedures / 

Semi -structured interviews were held with' the elementary Directors of 
Instruction at each Region and with the Curriculum Alignment Coordinators 
at each sample school. Questionnaires were distributed 'to 237 teachers. 
Of these, 190 were retrieved, representing an 80% return rate. 



SUMMARY AND RECOMMENDATIONS 

There do not seem to be any major program implementation problems and the 
general regard for the program and its usefulness- seems to be quite positive.. 
There is variation among schools with regard to training, with many receiving 
support and direction directly, from SWRL staff rather than from regional staff 
as was' intended for this year. The schools"^ that were older in the program 
had perhaps already established rapport with SWRL staff in previous years. 

The most significant point that emerges from this data is that the program 
activities are more important to those teachers who have been in the program 
for less time. it appears that teachers in schools that have participated 
in the program for three years or more are less enthusiastic about the 
alignment process, when thi.^ is viewed with the Directors of Instruction 
concern about increased instructional strategies, it can be inferred that 
the program itself is limited for long-term use. Put. another way, once 
teachers have mastered the fundamental steps in the alignment process and 
continue to use them as appropriate to sound instructional planning, the 
value of the activities as a "program" ceases to exist. 

a 

o 

!1 
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Recommendations 

1. That the instructional planning process inherent in the program be 

offered to teachers at schools as a part of general school in-service 
and management on an as-needed basis, but not as a "program". 

2 That the District develop additional ways of assisting teachers to 
expand teaching strategies, once learning needs of students have 
been identified. 



PROJECT TEXTBOOK 



PROGRAM DESCRIPTION 



This program was designed to improve the quality of instruction at 
participating schools by ensuring that all students have individual textbooks 
for academic subjects. Methods used to achieve this goal included (a) 
determining textbook overages and shortages at each school ,Jb)^ 
school inventories with-Di-strtct inverc^ staff development 

which focused on the appropriate use of books, (d) encouraging students to 
take responsibility for the textbooks, and (e) involving parents in P^°n,oting 
students' book maintenance responsibility. The program operated in all 298 
PHBAO schools . 

' METHODOLOGY 

The proposed sample .consisted of 4 schools of 'each school type. The obtained 
sample consisted of 12 schools: 3 elementary, 4 junior high,, and 5 senior 
high schools. (One elementary.school declined to take par t^ in data 
collection. The principal .of^his school Contended that, while eligible 
for project Textbook, they did not participate because they had enough 
books and -'...even gave books away.") At.each scTiool, inter/iews were to 
be conducted with the Principal/ the Book Coordinator, and 4 randomly 
selected teachers. "'In secondary schools,, teachers were to be instructors 
in the basic or academic curriculum. The planned sample was to consist of 
72 respondents: six at each school. The obtained sample consisted of 69 
respondents, for a response rate of 96%. Sample data are presented in Table 1 
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Table 1 



Project Textbook 
Sample Description 

i 

NuiAoer »§f Respondenjt Types by School Type 



School 
'Type 



Elementary 
(N=3) 

„Junior„High 
(N=4~) 

Senior High 
(N=5) 

Total N 



Respondent Type 



Principals Book 



Coordinators 



Teachers Total N 



5 
1 1 



4 

11 



12 



V- 16 

\ 



\1Gr 

47 



18 

23 

28 
69 



Data collection took the form of structured interviews with the respondents, 
Two types of instruments were used: an interview form for Administrators 
(e.g., Principals/Book Coordinators) and one for Teachers. Each interview 
lasted approximately 20 minutes. 



SUMMARY AND RECOMMENDATIONS 

Project Textbook appears successful in achieving its primary goal \of insuring 
that all students have individual books for each academic subject. \ But 
it does eppear that teachers do not distinguish between project textbook 
and the District's general textbook program. The majority of teachers 
indicated that students havo their own books for each basic subject and 
that they allow students to take books home more often than they did three 
years ago. Moreover, the quality of books appears to.be good. Teachers in 
all school types, reported that the books were grade-appropriate and reflected 
positive ethnic images. In general, toachers felt that Project Textbook 
positively affected their classes, especially in terms ol; book availability 
and increased student responsibility. 

Project Textbook is somewhat less successful in terms of administrative 
procedures used to provide^, students with books. Of the two major procedures 
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used -•- the centralized inventory and the comput\i:i2ed printouts -- 
administrators considered the former more helpful\than the latter. While 
most teachers felt- the centralized inventory system made the process easier 
than three years ago, they still felt it was not paV^ticularly helpful. And 
while some 40% of the administrators felt the computerized printouts were 
useful, most reported that the computerized system did not reduce paperwork. 
Administrators argued that school staff still had to>o much of the background 
work for the printouts. \ 

Teachers tended to be negative about the use of a commoV set of district- 
specified texts. Their basic complaint was that the coii^on set of books 
could not accommodate diversity in student ethnicity, interests, and 
achievement level. In general, parent involvement has b^en minimal and 
limited to receiving information about bocvs . 

We recommend that: 

1) the District continue. its successful efforts to provide^each student 
with basic books - » 

2) the District designate a coordinator to explain the progVram's purposes 
and profcedures as differentiated from the District's general textbook 
program, and to obtain feedback about the program ' s progress 

3) the District consider the use of supplementary or auxiliary texti to 
supplement the basic books \^ 

4) the District develop a plan for parent involvement or eliihiinate such 
involvement as a major aspect of Project Textbook.- 



STUDENT-TO-STUDENT INTERACTION PROGRAM 



PROGRAM DESCRIPTION 

The Student-to-Stuient interaction Program is designed to increase^ PO^^^""^® 
student interaction among students of different ethnic groups. The specific 
objectives of the program are to: reduce social isolation, promote inter-, 
cultural/racial understanding, and promote positive student interaction. 
These objectives are to be fulfilled through Sea Education Afloat (^EA) 
activities and Camping. \ 

\ 

\ sea Ed ucation Afl oat is a day-long activity. Paired schools board a boat 
'out of the 22nd Street Landing in San Pedro. The cruise itself is a three- 
hour long instructional activity. The eight study cruises which are^ 
available give students an opportunity, to learn from a lecture and t^ use 
plankton nets, microscopes, an otter trawl net, bottom samplers, water 
samplers, water testing kits, sextants, radar, and other oceanography^ 
equipment. The activity is intense and stimulating. 
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Camping is a 2 1/2 day activity which te^.^es place at one of three camp 
sites: Camp Hess Kramer, Hollywoodland, or Camp Cottontail. Itie Cotton- 
tail camp is used for all junior and senior high schools* camping experiences. 
The elementary schools may participate in one of two ways: 1) They may 
select a self-contained class to attend camp, but only those students on 
the teachers class register may go. Also, students from other classrooms 
may not serve as substitute3 or replacements. 2) They may select any 25 
students from grades 4-6 to attend camp. The enrollment is strictly enforced 
and there is an attempt made to have equal numbers of boys and girls. Each 
school is responsible for sending at least one certificated person and one 
non-certificated adult, a male and a female if possible. Both are responsible 
for staying in the cabins with the students. 

The junior and senior high school camping experiences are limited to a total 
of 80 students. A ratio of one adult to ten students is maintained. On^s half 
of the adults must be certificated. Daly- to-day substitute money is provided 
to the secondary schools for the four certificated persons who attend car*p'. ' 
The camp curriculum includes human relations /. multicultural education, and 
environmental education. The students ^nd staff participate enthusiastically. 

■ ' ' . - \ 

Associated with Camping and SEA are pre-j and post-activities. The pre- " 
activity is conducted to^ insjjre _ tha t-the-p^ prepared to take 

an active YoUer The post-activity serveW as a culmination. 

LAUSD schools participate in a paired fashion consisting of PHBAO and non- 
PHBAO schools. The schools are paired by the central office staff and the 
staff of the several regions which utilize comnanity liaisons. Principals 
are then asked to select their sites' participants^ Takbhers, students, 
and counselors are selected. Other adults such as parents and aidos may 
also participate. \ \ 

\ 

> ■ . : • \ ° ■ 

METHODOLOGY \^ 

This program was evaluated by observation, 1 intervi.ews, and doWment analysis. 
Observations were conducted ,at three car.ps: Hollywood land, He^ss Kramer, and 
Cottontail. An observation rating scale was employed to record the degree 
of interaction between the camp participants. The researchers ,\ additionally , 
recorded summary observations^^ primarily describing the milieu. \ Observations 
were also conducted at the Sea Education Afloat. An observation', rating 
^ scale was employed to record the degree of interaction between the 
participants. As in t^e camping activity, the researchers also recorded 
their impresssions of the activity as well. The pre- and post-sessions 
were evaluated through interviews and document analysis. 

I 

Interviews were conducted with the Student-tb -Student Program coordinator, 
three camp directors, and the Sea Education Afloat coordinator. 

I 

Data were also compiled from the various program* .description pamphlets. 




SUMMARY AND RECOMMENDATIONS 

An evaluation of the Student-to-Student Interaction Program indicates that 
this program is successful in varying degrees in fulfilling^ its objectives 
to reduce racial isolation, promote intercultural/racial understanding, and 
to promote positive student interaction. The first objective is more 
uniformly fulfilled by virtue of moving students from racially isolated 
schools to racially mixed activity situations* 

There are two aspects associated in fulfilling the second objective. Firsts 
interracial student mixing varied. The second aspect is that the curriculum 
contains precise, interesting, and varied materials about the various 
ethnic/racial groups. Additionally, this curricular offering varied in 
frequency and system. Promoting intercultural/racial understanding is 
more likely to occur when it is the activity's primary goal. Some activities 
served as facilitators, but this study's data indicate that an otherwise 
worthwhile activity may or may not contribute to interracial understanding. 
The varying degrees to which this goal is fulfilled is dependent on the 
extent to which the activity focuses on it. 

-The third objective is fulfilled in varying degrees in each of the activities 
When pre- and post-activities concentrate on directions and information, 
interaction decreases. When students engage in sharing information, 
interaction increases. 

The Sea Education Afloat Program is an effective intellectual program. It 
is not effective in promoting interaction. It is necessary to program 
student interaction if this objective is to be fulfilled. The camping 
activity provides opportunities for other intense activities such as 
camping intense activities, evening song fests, physical education games 
such as volley ball, -partner games such as checkers, etc. which may 
inhibit interaction. A conscious attempt to balance these two types of 
activities will insure that this objective is fulfilled. ^ 

It is recommended that: 

1. in carrying out each of the activities, the objectives be specified 

2. each activity include components which increase student -student 
interaction and/or student-teacher interaction 

3. pre- and post-sessions be emphasized as part of the Camping and SEA 
activities, e.g., that more descriptive information and examples 

of activities be made available 



4. 



Sea Afloat be completely revised or dropped as, a component of the 
Student-to-student Interaction Program. 



SUPPLEMENTAL COUNSELING PROGRAM 



PROGRAM DESCRIPTION ^ 

Providing additional counseling assistance to senior high school PHBAO 
students is the primary goal of the Supplemental Counseling Program. The 
theoretical basis of the Program is to approach counseling from a '•holistic" 
(whole-child) perspective. The premise being that if students are to obtain 
maximum benefits from their three-year senior high school- experience, the 
counseling they receive should focus pn all aspects of their being, e.g., 
personal, social, academic, college, career, etc. The specific me.thods 
that are used to deliver the counseling were determined by the respective, 
PHBAO school. 

One general objective of the Supplemental Counseling Program is to have 
in place at each PHBAO senior high school a , maximum pupil-counselor "ratio 
of 375:1. It was^ the belief of the Program^s planners that 'this lowered 
ratio would permit counselors to meet directly the special needs of ^all 
students either individually or in group settings. In addition/ it^as 
the hope of the Program planners that the counselors would retain the same 
students as counselees for the duration of the students' senior high, 
experience. 

Counselors selected to participate in the Supplemental Counseling Program 
are responsible for providing direct help to students who require indivi- 
dualized, group counseling, or classroom guidance , activities . - The counselors 
also work with other school personnel to decrease the students* feelings 
of isolation as well as to increase the students' self-esteem and regard 
for others. Furthermore, the counselors are responsible for assisting 
pupils in the ix efforts to satisfy specific graduation requirements and 
in maintaining accurate records of their educational progress. 

The selection of counselors with the knowledge, ability, and skill to work 
effectively with PHBAO students, parents, staff, and community is made 
by the PHBAO senior high school principal. The administrator is also in: 
charge of providing direction to the counselors once ^uelected. Recruitment 
of appropriately qualified counselors for participation in the Program 
was extended to all existing District staff and^ other qualified persons 
from outside the District in order to maximize the potential resource 
pool for the selection of Program counselors. 

METHODOLOGY 

Sample * 

All of Los Angeles Unified School District's PHBAO senior high schools 
were allocated supplemental counseling positions in order to establish 
the 375:1 pupil-counselor ratio* A total of 106 positions were allocated 
by the District. All had been filled at the time this evaluation was - 
completed. Twenty-three schools were eligible to serve as sample schools 
for. this evaluation. Only 12 schools, howe'ver, were selected at random 
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to comprise the school sample. 

From this sample of schools; evaluative ' information was Obtained from two 
respondent groups, counselors and students. Specifically, four counselors, 
two Supplemental Program counselors and two regular counselors, from each 
6f the 12 sample schools constituted the counselor sample. Thus, there 
were 48 respondents, 24 Supplemental Program counselors (50%) and 24 - ^ 
regular counselors (50%), that comprised the counselor respondent group. 

The second respondent group was 36 -students who, like the counselor group, 
was selected at random from the 12 sample schools. Specifically, three 
students from each high school, representing each grade level, i.e 
tenth, ele^^enth, and twelfth, constituted the student sample. 



Instruments 

A structured' interview format was the assessment procedure used to evaluate 
the Supplemental Counseling Program. Two specially designed interviews 
were used. The first was developed to obtain feedback information from the 
counselor respondents and the second from the student (coanselee) respon- 
dents. 

The counselors in the study sample responded to a 35-item interview. The 
inventory was «o structured that the counselors responded either to a 
forced-choice item or to an open-ended type item. 

Feedback from t^ie second respondent group, .the students, was also .obtained 
via a structured interview. As was true for the counselors, the interview 
questions Wljre of the 'open-ended or forced-choice version. The student 
interview consisted of a total of 22 items. i 



Data Collection Procedures 

Both the counseibr and student interviews were conducted at t^ie home, 
school of the particular respondent. All interviews were on. a one-to- ^ 
one basis and were transacted by a staff member of the Los Angeles 
Unified School District's PHBAO_ Evaluation Unit. In solipiting the 
counselors' and students' responses, care was taken to maintain.^ the 
anonymity of the respondents. All were informed that their responses 
would be treated confidentially and would be reviewed only by the PHBAO 
evaluation staff. , . , ' ■ 

SUtWARY AND RECOMMENDATIONS- 

The discussion of the findings is organized according to the two foci of 
the supplemental Counseling Program's evaluation. These are (1) the 
Program's impact with regard to providing additional counseling services to 
PH8A0 senior high school students, and (2) the Program's implementation at 
the various high schools. 
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Provision of Additional Counseling Services 



In relation to the Program's first goal, both the counselors and students 
who participated in this evaluation wert highly favorable concerning the 
availability of additional counseling services that exist as a result of 
the Supplemental Counseling Program. Prom the interviews it was learned 
that students believe, beyond a doubt, that on their respective campuses 
there exist many different types of available counseling services. The 
two most valued services are individual counseling and class advisement • 
In addition, there was total agreement among the counselors interviewed 
that within the Supplemental Counseling Program's framework "students are ^ 
able to work with counselors when they (the students) have expected or ■ 
unexpected needs." An overwhelming majority of the students confirmed \his 
-assertion. However, only 53% of the student s^ample were of the opinion ' 
that^ there is a sufficient number of available counselors who service , " 
PHBAO high schools. 



B'eedback from the counselors also indicated that group and individual 
counseling were the two methods used most frequently by the counselors in 
their dealings with students. The students reported the greatest given by 
counselors to be in^the articulation of specific course and graduation 
requirements. On the other hand, matters related to career counseling 
received the least favorable comments. The maintenance of students' 
educational records, improvements of studeiits* academic achievement, increased 
parent, involvement in the educational affairs of their offsprings, and 
helping students resolve personal problems ware mentioned as positive 
features of the Supplemental Counseling Program by both counselors and students 

Implementation of Program 

The evaluative information obtained concerning how the Program was implemented 
. was far more diversified than the views related to issues concerning the 
availability of services. For example, while a majority of the 48 counselors 
interviewed reported being at schools where the 375:1 pupil/counselor ratio 
was not violated, the ratios ranged from a high of 462 : 1 to a low of 200:1* 
And, over half (60%) believed the existing level remains "too high.". In 
. addition, there was extreme diversity among the counselors with regard to the 
percentage of time each reported engaged in "counseling" and/or "noncounseling" 
duties. Some indicated 100% involvement with counseling duties, others 
only 15% time with such duties. ^ 

The effectiveness of the Supplemental Counseling Program in bringing about 
regularly scheduled counseling for students appeared clear. All of the 
counselors (100%) indicated they are able to meet individually with students, 
while 85% reported having group meetings with students. Yet, 97% of the 
students responded affirmatively when asked "Do the counselors meet 
individually with students?" and'only 44% responded "yes" when asked if 
counselors meet in groups with students. Lowered student/counselor 
ratios, the termination of the whole-child approach, a reduction in . paperwork, 
counselor in-service training, and the elimination of needless supervision were 
3ome of the recommendations given by the counselors when requested to make 
suggestions for improving the scheduling of counseling. With regard to the 
whole-child approach, only about two -thirds of the counselors (67%) supported 
_lthe_approachT-and'^the exact same percent responded "yes" when asked „if they 
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needed assistance in implementing the approach. 

It was not su^^^sing to discover that the aspects of the Supplemental 
Counseling {program best liked by the counselors related to idiosyncratic 
characteristics of the Program, e.g., the lowered student-counselor ratio, 
the three-yekr counselor/student assignment, and the utilization of the 
whole-child approach'. Likewise, those features best liked by the students . 
were offshoots of the Program's idiosyncratic properties, e.g., the 
availability of counselors, encouragement received from counselors, 
resourcefulness of counselors, class assignments, college information, and 
having that "special someone at school to help." 

Based on the feedback received from this evaluation, i.e., the information 
gathered from the students and counselors, both regular and Supplemental 
participating in the Supplemental Counseling Program, the following 
recommendations are proffered for consideration: 

1. That there be an effort made to determine, establish, and monitor, the 
375:1- student/counselor ratio at each PHBAO senior high school. 

2 That there be on-site observations made of the Supplemental Counseling 
Program in order to aid individual PHBAO schools in identifying partic- 

. ular implementation problems, e.g., interruptions caused by irrelevant 
" teacher referrals, and ultimately in resolving these problems. 

3 That there be an in-depth analysis of how the whole-child approach is 
implemented at each school and a determination made of the difficulties 
encountered. Where appropriate, mechanisms for providing assistance 

in carrying out the approach should be identified and procedures 
estab.lJshed for the utilization of such assistance. 

4 That there be clearly defined procedures established for the execution 
/ of career counseling, e.g., with Career counselors or with the on-line 

counseling staff. 

■5. That there be District sponsored in-service training to aid counselors 
in identifying and using the most expedient procedures for maintaining 
student logs, documenting contact with counselees, and reducing paper- 
work and clerical chores. - ^ 

6. That there be an in-depth analysis focusing on ways to augment counselor 
time and to increase the number of available counselors for students. 



-24- 



31 



CHAPTER III: TOTAL PRCX3RAM EFFECTIVENESS 



Several programs have been instituted in the LAUSD in order to provide par- 
ticular types of assistance to PHBAO schools. These programs were designed 
to improve curriculum, educational leade^'^ and teacher quality. This 

chaptter describes the results from a progruL^ effectiveness survey covering 
all of the PHBAO components. 



METHODOLOGY 

The survey consisted of questions which addressed each program and the 
objectives to be fulfilled. The overall effectiveness of each of the pro- 
grams is presented in tv;o different ways: 1) Have the program's objectives 
-been fulfilled? 2) Have the programs improved curriculum, educational 
leadership, or teacher quality? 

\ 

SAMPL E 

The sample consisted of 124 schooIs^iiraWn during the 1982-83 school year. 
Sixty-four elementary, 37 junior high and 23 senior high schools were in- 
volved. Year-round schools were included in this sample. Proportionate, 
stratified random sampling was used to achieve an adequate representation 
from all administrative regions. A total. of 16 schools were selected. All 
administrators, 4th, 6th grade and secondary teachers, parents and students 
were included in th-^ sample. 

SUMMARY AND RECOMMENDATIONS 

The seven programs designed to improve teacher quality have fulfilled their 
objectives for the most part. The Bilingual Classroom Teacher Program is 
reported by teachers and administrators to be effective in improving teacher 
quality. It is likewise, reported that it is fulfilling its other objectives 
The objectives are: 1) having qualified^^bi lingual teachers agree to assume 
additional duties with/for students for 2 1/2 hours each week, 2) improving 
the instruction of LEP students, 3) improving the service for LEP students, 
and 4) providing tutoring services. 

Parents also reported that the program is being effective. It is effectiv^ 
in: 1) helping their child be a better student, 2) having teachers spend 
time with their child, 3) providing .special services to their child, 4) 
improving the curriculum, 5) improving the instruction, 6) improving the 
services to the LEP students, and 7) increasing tutoring services. This . 
program's effectiveness is, . therefore, positive. 
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The Class Size Reduction Program is rated by teachers and administrators as 
effective in fulfilling its objectives. The objectives are: 1) facilitating, 
teacher /student instructional interaction within the classroom, 2) maintaining 
the 27:1 class size reduction, 3) increasing opportunities for reinforcement 
of learning in the classroom, 4) increasing the number of student/teacher 
counseling sessions. Since the objectives of: this ^program are being 
fulfilled, it may be inferred the program is effective in improving teacher 
quality. Therefore, the effectiveness of this program is positive. 

The Language kcguisition Program is not rated as very effective in fulfilling 
its objectives. Its objectives are: 1) Improving teaching skills, 2) « 
improving participants' instructional performance, 3) improving teachers ' 
confidence working with LEP students and their families, and 4) improving 
teachers' self-rating of their Spanish language ability. Because objectives 
are not being fulfilled, it is likely that this program is not effective in 
improving teacher quality. 

parents rate this program more positively. They report the program has 
been helpful in improving -the teachers' communication with' parents and that 
the teachers interact and communicate with them about their child's schoolwork 

TWO varying perspectives regarding this program call attention to further' 
investigation. The effectiveness of this program is, therefore, questionable. 

The Leadership Training Team Program is rated by teachers and administrators 
as effective in improving tea~cher quality. It is, likewise, rated effective 
in fulfilling its objectives. The objectives are: 1) facilitating staff 
development specific to local school needs and 2) facilitating staff 
development to fulfill Dp^ct goals. This program's effectiveness is, 
therefore, positive. A \ 

The Mai ntenance /Al teration/ Improvement Program is rated by teachers and 
administrators as effective in fulfilling Its objectives. The objectives 
are: 1 ) decreasing the time interval between maintenance request and 
implementation, 2) decreasing the time interval between starting and 
completing maintenance projects, 3) improving the maintenance of the school 
plant, and 4) improving the gafety of the physical plant. This program's 
effectiveness is, therefore, positive. 

The St aff Development Program is rated by teachers and administrators as 
effective in improving teacher quality. It is, likewise, rated as effective 
in fulfilling its objectives. The objectives are: 1) meeting specific 
local school needs, 2) developing instructional strategies to improve 
, student self-esteem, and 3) developing instructional strategies to improve 
student, achievement. This program's effectiveness is, therefore, positive. 

The urban Classroom Teacher Program is rated by teachers and administrators 
as effective in Improving teacher quality. It is, likewise, rated as 
effective in fulfilling its objectives. They are: 1) recruiting teaching 
staff since it began at their schoo.l, 2) retaining teaching staff since it 
began at .their school, and 3) reducing teacher absenteeism. 
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Parents also rate this program as effective. It is effective in: 1) helping 
their child be a better student, 2) incjcreasing additional services to their 
child, 3) increasing tutoring services to their child, 4) increasing the 
number of clubs available to students, and 5) increasing the guidance and 
counseling services to students. This program's effectiveness is, therefore, 
positive. 

Teachers and administrators reported that the Total PHBAO Programs have been 
effective in improving teacher quality. Teachers and administrators reported 
that these programs have been effective' in impro.v5.ng the quality of 
instruction. Teachers and administrators reported that the PHBAO Programs 
have been effective in improving teacher morale. Teachers and administrators 
reported that the programs have been effective in improving parents* 
perceptions of schools « Teachers and administrators reported that the 
programs have not been effective in increasing the percentage of students 
who graduate from high, school. Teachers and administrators reported that 
the programs have been effective in improving students' self-esteem. 
Teachers and administrators reported that the programs have been effective 
in improving teachers* beliefs in students* potentials. Teachers and 
administrators reported that the programs have been effective in improving 
students* achievement. Teachers and administrators reported that the PHBAO 
Programs have been effective in increasing -parental participation. The 
only objective which these programs are perceived as not fulfilling is 
increasing the percentage of students who graduate from high school. In 
general, the PHBAO program's effectiveness is positive. 

It is recommended that: 

1 , PHBAO programs be continued I 

2. the following programs be 'reviewea'"^t)r consistency in fulfilling 
objectives: / ^ 

Language Acquisition Program / 
Project AHEAD 

Computer Assistance Program 



CHAPTER IV: ATTITUDE AND ACHIEVEMENT TESTS 



SCHOOL ATTITUDE MEASURE 

* 

DESCRIPTION OF INSTRUMENT 

A basic^objective of the PHBAO Program is to bring about affective changes in 
s,-udents. To assess such changes, if any^ test score information from the 
School Attitude Measure (Scott, Foresman and Company, 1980) was obtained. 
The School Attitude Measure (SAH) is a norm referenced test that is specifically 
designed to examine several dinensions of student attitude expression. Five 
attitude scales are included in the SAM. . 

1. Motivation for Schooling reflects -the effect of . students ' reactions 
to their past school experience as it. relates to their motivation in 
school. 

2. Acaderuic Self -Concept-Performance Based focuses on students' 
confidence in their academic abilities and their feelings about 
their school performance, 

3. Academic Self-Concept-Reference Based deals with how students 

think others (teachers, family, and friends) feel about their school 
performance and their ability to succeed academically. 

4. Student's Sense of Control Over Performance measures students'^ 
feelings about their ability to exercise control over situations 
that affect them at school events such as grades and promotions.. 

5. Student's instructional Mastery ascertains students' perceptions 
regarding the state of their actual school skills. 

Based on reading difficulty, there are three available forms of the SAM: 
Level 4-6, Level 7-8, and Level 9-12. Each f orm-contalTO'-'appfoximately 
250 items to which the student, using a four-point scale (i.e., never agree, 
sometimes agree, usually agree, always agree), responds to a descriptive 
statement about school life, e.g., "I lesirn things very quickly in school." 

Normative data for the SAM were gathered during the 1979-80 school year 
from 28f300 students representing the national population with respect to 
geographic region, socioeconomic status, and school district size. Students 
from both private and public schools were included in the sample. 

Reliability estimates for internal consistency of the SAM range .from .91 
to .95 for the total test and for test-retest from .80 to .89. .Separate 
norms are provided for grades 4 through 12. Directions for administration 
of the SAM are provided in both English and Spanish. 



Sample ' ^ . \^ 

SAM data were collected from both non-year-round schools and year-round / 
schools, information from the non-year-round schools came from three 
sources: 1) 42 schools (32 elementary, 5 junior high, and 5 senior high) 
that were included in the 1980-81 test sample; 2) 77 schools (64 elementary, _ 
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8 junior high, and 5 senior high) that comprised the 1981-82 evaluation; 
and 3) 86 schools (64 elementary, 8 junior high, and 1'4^' seni'or high) that 
were selected for the 1982-83 school test sample. \ 

Data for the year-round schools came from two sources: 1) six elementary 
schools that were selected as sites to obtain sixth grade SAM test data for 
the 1981-82 Year-Round test sample, and 2) six elementary schools chosen 
to gather sixth grade data for the 1982-83 school evaluation year, 

SUMMARY 

The information presented in this section summarizes the results obtained 
from the. analyses of the SAM data obtained from non-year-round and year- 
round PHBAO program schools. To reiterate, -the analyses were intended 
to answer three primary questions: 2^? 



1 • \yo the attitudes of non-year-round PHBAO program students differ 
from students at the national level? 

2. Do the attitudes of non-year-round PHBAO program students improve 
over time? 

3. Do the attitudes of yeeir-round PHBAO program students improve 
over time? 

To summarize briefly, the results from the first analysis, examining the non- 
year-round PHBAO program school scores to national norms, indicate two 
primary findings. First, there were definite trends for grades six and ten. 
The students* self-reports at these two levels concerning their beliefs 
regarding how positive they are about "past school experience," their 
beliefs regarding their academic ability and performance, and their views 
about their school slcills were generally less positive than those expressed 
by students in the national standardization sample. The disparity between 
the two groups of students was greatest in the area of motivation. The 
second major finding concerned the PHBAO students • attitudes concerning 
their motivation for schooling. Regardless of grade level, the PHBAO 
students were uniformly less positive than were the students in the 
national standardization sample. The data appear to strongly suggest that 
PHBAO student do feel less positive about,their school experience which in 
turn lilcely affects how hard they work in school,-, how much they value school, 
and how much they want to pursue further schooling. Why students completing 
their elementary school experience (sixth graders)'and those completing 
their first year of senior high school (tenth graders) were" consistently 
less positive in all attitudes examined and why PHBAO students in general, 
regardless of grade level, are le€8~pbfiitive with regard to school motivation 
are two extremely important questions that surfaced from this evaluation. 
While it is beyond the scope of this report to answer such questions, they 
must surely be addressed if educators are to understand the educational 
process as it affects students who attend predominantly minorijby schools. 

The data obtained from the second analysis provides the basis for the 
conclusions regarding changes in the non-year-round students' attitudinal 
responses over time. The major finding concerning this aspect of the program 



is the elementary students' self-reports regarding their motivation for 
schooling, their self-concept based on school performance, and their beliefs 
about their academic skills. In all three instances there were slight 
improvements ov«>r the three-year testing period. This pattern was not 
evident at the secondary level, instead, what emerged at grades* eight and 
ten were improvements in attitudes, deteriorations in attitudes, and con- 
stancy in attitudes. In general, then, the affective attitudes of the 
PI^BAO elementary school students do tend to improve throughout the ele- 
mentary school experience. Whether these improvements continue or maintain 
themselves during the junior and senior high years cannot be determined. ^ 

Finally, evidence obtained from the analysis of the year-round PHBAO 
program schools produced the following finding: There were slight improve- 
ments in the attitudinal responses obtained froir. the sixth grade students 
during the 1981-32 and 1982-83 school year evalaat ' .ns. In thex fs, tae 
year-to-year contrast revealed that students' feedback regaraing ireir 
cpnfidence in their academic abilities and their feelings about their 
school performance, their feelings about being abiu to exercise control 
over situations that affect them, at school and to take responsibility f : 
the outcome of relevant school events, and their beliefs about the 9^ ..ze 
of their actual school skills all improved over the two-year testing 
period. 



ACHIEVEMENT TEST DATA 

Achievement test data were collected through the District's regularly 
scheduled testing program in Spring, 1983. Data were drawn from the same 

77 schools used in the 1981-82 achievement testing sample: — 64 elementary 

schools, 8 junior high schools, and 5 senior high schools. Two achievt^ 
ment tests were used: at the elementary level, the Survey of Essential 
Skills (SES), and at the secondary level, the Comprehensive Test of Basic 
Skills (CTBS) . 

For the SES, 32 elementary schools were randomly selected for 4th grade 
testing and the remaining 32 schools were used for 6th grade testing. Within 
each of these grade levels, all students £)resent were tested, yielding the 
following sample:/ 4th grade - 2,977 students; 6th grade - 2,820 students. 
At the secondary level where the CTBS was used, 3,259 eighth grade students 
were tested and 909 tenth grade students. (The District testing schedule 
included only two of the five senior high schools in the designated sample.) 
' The total number of students tested, then, was 9,965: 5,797 at the elementary 
level and 4,168 at the secondary level. 



METHODOLOGY 



Description of Instrument - Elementary 

The Survey of Essential Skills (SES) is a criterion-referenced test developed 
by the Southwest Regional Laboratory (SWRL) and District personnel. It has 
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been adopted by the District for universal use in the elementary schools. 
The test, for which a separate version is prepared at each grade level, 
assesses grade-appropriate skills in the areas of reading, mathematics, 
language, and written composition (grades 3 and 6, only). The tests, 
administered in the classroom by homeroom teachers, were untimed and on the 
avei^ge lasted from 40 to 60 minutes. Answeris to multiple choice items 
are presented in terms of the mean percent of correct answers. Mastery - 
level categories represent the following mean percent correct answer ranges: 
Mastery - 75 and above; Approaching Mastery 55 to 74? Non-Mastery - 54 and 
below. 



Sample Description - Elementary 

Of the basic 64 elementary school sample, 32 schools have been in the 
program for three years and 32 have been in the program for only two years. 
Table 1 describes the schools in terms of grade level tested and length of 
program implementation • ' . ' ' 



Description of Instrument - Secondary 

^!ie CTBS is a series of standardized, norm-referenced tests designed to 
measure skills common to all curricula. The CTBS was standardized on a 
national sample of students. The test covers six basic skill areas, two 
of which are used by the District: reading and matehmatics. The items on 
each test measure the student's ability in five broad intellectual processes 
xacixgnition . translation, interpretation, applica tion, and analysis. Test 
items were multiple choice, and scores represent the lnedi"a7rT)Brceirt±-ie~forT 
all. students in a specific grade at each school. 



Sample Description - Second ary 

As part of the District's regular testing program, the CTBS was administered 
to the eight junior high schools and only two high schools in the sample. 
Of the eight junior high schools, five have been in the program three years 
and three for two years. Both of the senior high schools have been in the 
program for three years . 



SUMMARY AND RECOMMENDATIONS 
Tables 1 4 describe the test results for grades 4, 6, 8, and 10.' 
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Table 1 



SES Results - 4th Grade 
Comparison of 1981-82 and 1982-83 Test Scores 



Subject 


Performance 
Range 


' 1982 
Mean % 
Correct 


1983 
Mean % 
Correct 

i 


Reading ^ 

" Mathematics 

Language'^^i: \ 
•i . ^- 


II 
II 
I 


65.97 
. 68.58 
78.12 


i 

66.78 

: 71 *72 

■ \^ 

78.59 



Table 2 
SES Results - 6th Grade 



■ ■ i M 

cdmparison 


of 1981-82 and 


1982-83 Test Scores 




■ i 1 "3 

Subject ; || 

- \ i; 


performance 
Range 


1:982 

Mean % 
Correct 


1983 
Meant 

Correct 


Reading \|| 


1 


80.74 


79.21 


, Mathematics ||^. 


11 


65.76 


68.47 


■ f\ ■ 
Language; || \ . 

ll \ 


11 




72.81 



\ 
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Table 3 



CTBS Results - 8th Grade 







Percentile 


Scores 


by Year of Testing and 


Length 


of Program 


Implementation 


■^^ 




Subject 


Year of Testing 








Program Implementation 




Reading ^ 


MatJiematics 


•J 

uuiij.vj£. nx^ii L^oniuxneQ 








1981-82 




27 


» 

38 


1982-83 






H 1 


Junior High - Three Years 








• * I' 
1980-81 




23 


30 . 


1981-82 




26 


37 


1982-83 




28 


37 


Junior High - Two Years 








1981-82 




31 


41 


1982-83 




29 


44 



CTBS Results - 10th Grade 

. - ... ^ _ '■• V*^^ 

Comparison of Median Percentile Scores r 

by Year of Testing • ^* 



^ Subject 

Year of Testing Reading Mathematics 



School A 



1980- 81 

1981- 82 

1982- 83 



9 
46 

13^ 



13 
26 
14 



School B 
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1980-81 
1;981-82 
1982-83 



13 
43 
12 
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4n 



15 
18 
15 



The upward surge of the test scores for both schools during the 1981-82 
school year is curious and ^beyon^-explanation in this analysis. 

At the .secondary level, movement ir^^achievement scores is ^ll^l^'^^l^lf.^^. 
performance levels remain well belowUhe 50th percentile. At the elementary 
?evel, there has been a far greater a>tdjnore encouraging degree- of improvement. 
For example, though the test scores for reading and language at b°th the 
4th and 6th grade level did not change appreciably, those for mathematics 
did- There was a marked increase in the percentage of schools whose^cores 
are in the .mastery level range from 1982 to 1983. This is true ^^^^^^^ 
elementary grade levels and in all subjects, with tne exception of 6th grade 
reading. The slight decrease in these scores however, does not move the 
overall 6th grade performance in reading out of the mastery range. ^Iso, ^ 
?here are no appreciable differences in scores in relation to school schedule, 
and though there are differences in scores tietween bilingual and , 
classroom schools, it can not be said that these differences are attributable 
to the type of teacher program. 

It is recommended that: 

1. test preparation be carefully monitored, especially at the secondary 
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2. 



concerted 'effort be continued toward t;he improvement of basic skills 
of students that can then be reflected in improved test scores. 
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CHAPTER V: AMELIORATION OP HARMS 



HARM; LOW ACHIEVEMENT 

EVALUATION ISSUES 

This study focuses on the salient strengths, weaknesses, and uniqueness of 
the schools as perceived by principals and teachers. Additionally, classroom 
activity, teacher education and experience, student and teacher attendance, 
class size, and teacher attitudes were assessed, 

Two studies in particular, were used as a basis for formulating the present 
evaluation issues: 1) Summer and White, "Which School Resources Help Learning?** 
Business Review , Federal Reserve Bank- of Philadelphia, February, 1975 (study 
of the Philadelphia public schools); 2) "Does the Usie of Resources Influence 
Student Achievement?", unpublished paper delivered by Richard Rossmiller/ Chair/ 
Department of Educational Administration, University of Wis cons in -Madison at the 
Fiftieth Anniversary Lecture Series, University of Hawaii, 1981. 

METHODOLOGY 



Sample , " - 

Schools comprised the fundamental sample unit. Using purposiva-^methodS/ 
two high^ achieving and two low achieving elementary schools were selected 
as were one high achieving junior and senior high school and^one low 
achieving junior and senior high school. The level of achievement was 
determined by 1982 SES 4th grade reading scores in the instance of elementary 
schools and CTBS reading scores at the 8th and 10th grade levels. Thesc^ 
scores from the total sample of eight schools are found in Table 1 • 

Table 1 

. HafSsVAna lysis: Low. Achievement 

if 

Comparison of i 982 Reading Test Scores for Low and 
High Achieving Sample Schools 



♦Achievement Status 



School . Lov^ Achieving High Achieving 



Elementary 1 




53 


88 


Elementary 2 




68 


88 


Junior High 




20 


35 . 


Senior High 




10 


42 



Elementary test scores represent mean percent correct answers. Secondary 



test scores represent median pexjcentiles. ^ 



Within these school units, all principals, all 3rd through 6th grade teachers, 
and "all 8th and lOth grade English teachers were involved. Thusly, the 
respondent sample included eight principals and 80 teachers: 48 elementary 
and 32 secondary teachers . 

There were 13 4th grade classes selected as observation sites. Within each 
class, 4 to 10 students were chosen for observation so that there were 
20 students from each school in the observation sample. 



Data Collection 

All eight principals in the sample participated in a 30-40 minute interview. 

Of the 80 questionnaires distributed to teachers, 74 were, returned, representing 

a return rate of ?2.5%. 

The students chosen for, study in etfch of the selected classes were observed 
for one reading period in the morning and one social studies or language 
period in the afternoon. To avoid student absence, both observations for 
' any given student were , completed in one day. 

SUMMARY AND RECOMMENDATIONS 

Some concrete differences between low and high achieving schools were noted: 
1 ) there is a slight trend for smaller class size in the higher achieving 
schools; 2) students in higher achieving elementary schools spend more time- 
on-task than those in lower achieving schools; 3) teachers make fewer 
interruptions for discipline at the higher achieving schools than at lower 
achieving schools; 4) teachers tend to be absent less at higher achieving 
elementary schools than, lower" achieving schools at that level,, but more at 
the higher achieving secondary ' schools than lower achieving secondary 
scKools; and 5) students tend to be absent more frequently at the lower 
achieving high school thfn at the higher achieving high school. Similarities 
between the two types of schools are noted with respect to 1) teacher 
educational preparation, ,2 ) teacher experience, and 3) student attendance at 
the elementary and junior high levels. 

Perhaps the nore meaningful differences, however, are those of a perceptual 
and attitudincl nature. The administration and staff at the schools with 
higher scores Sc-amed to be focused on, their educational activities, on 
issues (like gradt level me^UM.S' i'^^^^^"^^^""^^^^"^®^^®^^ about which 
they have some cont.-ol. By conlfa^t,- those at the lower achieving schools 
raise most concerns abou- things external to the school, that heavily impact 
the school but over which uiey have less control (gangs, lack of community 
support, inadequate budget). Attitudinally, far more teachers at high 
achieving schools are positi%/e about student behavior, achievement, and 
capacity to learn than are fc;achers at low achieving schobls. Also, the 
highest percentage of teache;.s at higher achieving schools are positive 
about student capacity to le.-rn, while .the highest percentage of teachers at , 
lower achieving -schools are ;;.ositive about collegial support.. 
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It is recommended that: 

1 • the District continue to focus on improved instructional strategies and 
classroom management 

2* there be continued emphasis on and support "given to teachers toward the 
enhancement of expectations of students 

3. in those low achieving schools surrounded by difficult socio-cultural 
conditions, greater attention be paid to teacher and administrative 
supports in order to nurture and maintain positive attitudes as they 
relate to student performance. 



HARM; LACK OF ACCESS TO POST-SECONDARY OPPORTUNITIES 



EVALUATION ISSUES 

In 1977 Superior Court Judge Egly identified lack of access to post-secondary 
opportunities as one of four harms of racial isolation. The PHBAO programs 
were subsequently implemented in an effort to ameliorate these harms. 

This aspect of the PHBAO evaluation attempts to identify factors which 
distinguish schools with high percentages of students seeking access to 
post-secondary opportunities from schools with low percentages of students 
seeking post-secondary access. - Based on the literature, the factors we 
expect to distinguish the high and, low schools include: 

Placemenit of students in vocational or academic classes 
Faculty expectations of students' post-secondary activities 

- Faculty perceptions of events influencing student outcomes 

- College attendance of students* family or friends - 

- Student access to college/trade school information 

If these or other factors are found to distinguish high and low access 
schools, such identification will allow District policy-makers and admin- 
istrators to incorporate elements of high access schools in the low access 
schools . 



METHODOLOGY 

We operationalized the construct "access to post-secondary opportunities" 
as the percentage of 1982 seniors who ^requested that transcripts )5e sent 
to colleges or trade schools . Because high achieving students are most 
likely to make applicatipn to colleges/trade schools, we controlled 
for achievement in our analysis. And because we were concerned that 
factors related to access might be different for PHBAO and non-PHBAO 
schools, the sample included a small group of non-PHBAO compariison 
schools . _ ■ 



School Sample 



The school sample consisted of 13 PHBAO high schools and two non-PHBAO 
comparison schools. The PHBAO sample was purposively selected from the 
universe of 23 PHBAO senior high schools. The comparison schools were 
purposively selected from nine non-PHBAO senior high schools which were 
similar to the PHBAO schools in Chapter I ranking and the percent combined 
minority students. 

Sample selection involved , obtaining the following information about each 
of the 28 schools*: 

• The percent of 1982 graduates who requested their tran-scripts 
be sent to colleges/trade schools 

• Mean percent correct items for 1 2th graders on the 1982 California 
Assessment of Program (CAP). . 

For PHBAO schools, the percent of transcripts sent ranged from 13.3 to 71.5 
and CAP reading scores ranged from 42.2% to 60.8% with a mean score of 51.1%.** 
For non-PHBAO schools, the percent of transcripts sent ranged from 38.8 to 
63.5/ falling within the PHBAO range. However, non-PHBAO achievement scores 
were higher that PHBAO, ranging from 52.5% to 63.8% with a mean score of 59.7%. 

Using percent transcripts sent and reading scores, we divided the PHBAO 
schools into four groups. We first divided the 19 schools into two 
approximately equal N groups for percent transcripts sent. The low group 
ranged from 13.3% to 40.4% and the high group ranged from 43.8% to 71.9%. 
All schools with achievement scores below the mean of 51.1%. were placed 
in the low achievement group and those with reading scores above the 
me^n were placed in the high achievement group. 

These procedures resulted in the following four groups of schools: 

• High percent transcripts sent, high achievement (HH; N « 7) 

• High percent transcripts sent, low achievement (HL; N = 2) 

• Low-percent transcripts sent, high achievement (LH; N « 4) 

• Low percent transcripts sent, low achievement (LL; N = 6) 

To obtain a sample of 13vPHBA0 schools, we selected the schools with the 
highest percent transcripts sent from the HH, and the schools with the 
lowest percent transcripts sent from the HH and LL cells. We Included 
both schools which were in the HL cell. 

We used the same procedures to select the non-PHBAO comparison group, 
including the division of schools into four cells based on the percent 
transcripts sent and achievement level.^ Kij then selected the HH cell, 
which contained two schools, as the compiaLrison group. 



*We were unable to collect transcript information from four PHBAO senior 
high schools leaving us with a sampling base of 19 PHBAO high schools 
and nine non-PHBAO high schools. 

**Scores denote percent correct. LAUSD scores ranged from 42.2% to 68.8% 
with an average score of 58.4%. , 
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Data Collection 

Data collection took the form of structured interviews, 
naire (see Appendix) was used for all respondent types, 
lasted approximately 30 minutes. 



SUMMARY AND RECOMMENDATIONS 

This aspect of the evaluation identified variables which distinguish 
schools with high percentages of students seeking access to post-secondary 
opportunities from schools with low percentages of students seeking post- 
secondary access. 

In general, we did not find, identifiable school practices which distinguished 
PHBAO high -access, PHBAO low-access and comparison schools (high access non- 
PHBAO) . Student visits to colleges/trade schools/businesses, availability of 
information about post-secondary opportunities, provisions for student 
leadership, etc. were comparable for all three groups. 

As we would expect, a JL^rger percentage of comparison respondents and high- 
access respondents than low-access respondents expected their senior students 
to attend college. Similarly, a larger percentage of comparison and high* 
access respondents than low-access respondents reported their students had 
family members who attended college. Both findings were mediated by achieve- 
ment effects. 

The most significant finding, perhaps, relates to staff attitudes towards 
and expectations of the students. Teachers, principals, and counselors 
viewed student variables (e.g., initiative, IQ, and parent encouragement) as 
much more important in determining student outcomes than school factors 
(e.g., quality of education and teacher encouragement). 

The variable, staff attitudes and expectations, becomes even more important 
since it consistently^} distinguishes among the high-access, low-access and 
comparison schools. Staff in the comparison schools Were more likely to be 
knowledgeable about student plans, about college attendance of students* 
families and peers, and about the quality^ of. information related to post- 
secondary access than were staff in high-access PHBAO schools. And staff 
in high-access PHBAO schools were more knowledgeable abbut these dimensions 
than staff in low-access PHBAO schools. . ■ 

Data suggest that at the comparison schools and, to a slightly lessisr 
extent, at the high-access PHBAO schools, school staff are more involved 
in the process of promoting s-tudent access than at the low-access PHBAO 
schools. Comparison teachers are knowledgeable about individual students 
in their classes, but more importantly, they have a sense of the direction 
and aspirations of the graduates. In short, staffs in these schools seem 
more intimately involved in the post-secondary plans and efforts of the 
graduating class. . ' 



A single question- 
Each interview 
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This involvement seems to manifest itself in a greater level of teacher 

support for the graduates. This support may nurture student achievement 

and subsequently, student plans to seek access to post-secondary institutions. 

Given these preliminary.' findings, our recommendations are: 

1 • Staff development at the high school level should emphasize the 
importance of teacher support and positive expectations for 
increasing students' access to post-secondary opportunities/ 

2. in addition to making college/business literature .available, to ^ 
students, teachers as well as counselors should be encouraged to 
be more interactive with students in interpreting i>4\feri[nairion 
provided. . ' . 

3. Schools should begin to identify more effective means of obtaining 
parent involvement in Career Day activities and post-secondary , 
information exchanges. 

4. School staffs indicated that school visits to colleges/businesses 
could be improved by having better student transportation, by 
scheduling visits during non-class hours, and by increasing the 
number of student participants. 

p • ■ 

5. Major post-secondary access activities should increasingly focus 
on sophomores and juniors, in addition to seniors. 

HARM; INTERRACIAL HOSTILITY AND INTOLERANCE . 

EVALUATION ISSUES 

In the process of school integration, the overiding issue has been the 
interracial relationships which result. The apprehensions have been based on 
^ whethfijr children from -Afferent racial and ethnic groups can- learn together 
in a schopl setting. A secondary consideration has been whether the adults, 
administrators, teachers, and others could cope with heterogeneous student 
groups. The^ intent has been to try to provide achool contexts in which 
interracial relationships couid develop in a positive way. 

Several aapects^of interracial relationships have bean invaatigated by 
researchers. Most studies have sought to explain how and what factors tend 
to contribute to the development for the most positive re.lationships. These 
studies have referred to these relationships as interracial^ contact (Patchen, 
1982; St. John, 1975; Cook, 1970; Allport, 1958). Their writings indicate 
that there are three elements which affect the development of positive 
interracial contact. They are: equal status, common goals, and institutional 
support for positive relations. 
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The intent of this report is to determine to what extent the three elemehts 
which' affect positive interracial contact were present in the PHBAO schools. 
The specific objective is to find out if interracial hostility and intolerance 
have been reduced • The report specifies whether the differences between high 
and low interracial hostility and intolerance schools are affected by certain 
school practices. The areas which are examined are: 1) school and classroom 
environment, 2) task involvement, 3) behavior patterns, 4) interaction ' 
patterns, and 5) school programs and activities directed at interracial 
hostility and intolerance. 



METHODOLOGY 

Sample 

School administrators from each area were asked to select schools which they 
perceiveri as high or low in interracial hostility. The selection of schools 
included elementary, junior high, and senior high levels,- A number of schools 
were selected for each lievel as high or low. This reporter selected, at 
random, one high and one low school, for each level. The total number of 
schools selected for investigation was six schools, two elementary, two junior 
high, and two senior high. Each level contained a high and a low scoring 
school in interracial hostility and intolerance. 

Instruments and Data Collection Procedures * 



On-site observation and interviews were the assessment procedures used to 
obtain evaluative information for this report. Specially designed observation 
instruments and interview schedules were used. They were: 

.1* 

School Observation Sheet - A structured instrument designed' to identify^ 
classroom and school characteristics. The "classroom materials, 
activities, and general appearance and characteristics were evaluated. 
The schools/ facilities and grounds were likewise evaluated. 

2. Interaction Patterris Observation Sheet - A structured instrument designed 
to tabulate student-student, , student-teacher, and student-other adult 
int<-».rciction in various settings. They were: classroom, playground, 
passing period, and lunch area. 

3. Administrator, Counselor^ Teacher Questionnaire - A structured interview 
designed to obtain information concerning interracial hostility and 
intolerance in their schools. 

Each school was observed for two complete days. Interview data were collected 
from principals, a^ssistant principals, teachers, and counselors. Anonymity was 
assured to all respondents. Additionally, field researchers were interviewed 
by this reporter as a means to triangulate the data collected by observation 
and interview. 
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SUMMARY AND RECOMMENDATIONS 



Schools displaying both high and low interracial hostility and intolerance have 
been examined. Elementary, junior high, and senior high schools have been 
identified. None pf the schools claimed or displayed interracial-hostility or 
intolerance. However, they all differed in the types of deterrence systems 
which they operated. The purpose of the deterrence systems was to equalize 
status among the school participants, to direct the members of the organization 
to engage in schooling by the provision of institutional support. 

Both elementary schools had deterrence systems. The one with low interracial 
hostility and intolerance has a system concentrated at the teacher and classroom 
level. The one wi^h a high interracial hostility and intolerance has its system 
permeating the entire instituiton. Additionally,^ all school personnel are 
engaged in activities which span the entire school.. - , 

The junior high schools also have deterrence systems. The one with low 
incerraci.6.1 hostility and intolerance has a modes.t system concentrating on 
interpersonal strategies. Addit.ionally, this school's personnel express a keen 
awareness of areas and contexts in which conflict can arise. Their interpersonal 
deterrence system* is designed to monitor these vulnerable spots. The .junior 
high, with high interracial hostility and intolerance has created a structure in , 
which two distinct ethnic student groups co-exist in parallel social systems. 
Within this school, administrators, counselors, and teachers are also structured 
in such a way that their activities and responsibilities remain separate and 
different. Teachers deal with classroom projects. Counselors deal with small 
group activities and administrators deal with general school functions. 7his _ 
contrasts sharply with the structure created by the high interracial .and 
intolerance elementary school. „ * 

The senior high schools have generalized deterrence systems. Their systems do 
not tend to be specifically designed .to improve interracial relations. The 
high school with low interracial hostility and intolerance engages intensely in 
academic activities which serve to equalize the status among the students by a 
modest support system. The high school with high interracial hostility and 
intolerance has a tendency to relinquish the responsiblity for interracial 
relations to others. There is a weak institutional system. The principal 
refers to "keeping a pulse in the community" 1^^^ ordpv to avert conflict. The 
imposition of rules and regulations and standards is another means for describing 
;.he deterrence system at this school. This system's direction of its members 
towards the common goal of schooling and its equalizing of status is equally 
imperceptible as is the presence of interracial hostility and intolerance. 

It is recommended that: 

1. schools continue to implement deterrence systems (parallel students' 
groups are not to be considered legitimate) 

2. deterrence system includa activities integrating faculty, staff, and 
students throughout the school organization 

3. deterrence systems be varied in activities and intensity. PHBAO 
programs such as Student-to-Student should be expanded 

4.. schools are aware of various kinds of successful deterrenQe systems. 



HARM; LOW SELF-ESTEEM 



EVALUATION ISSUES 

The impact the school environment makes on the development of children's 
self-esteem is a topic of continuous concern to educators and the public 
at large. The school is recognized as the socialization grounds where 
children are given opportunities > to explore their boundaries as human 
beings. Although .the family is considered the. basic socialization unit 
up until the time when youngsters enter school, the school continues withx 
this socialization process by aiding in the development of the child's 
cognitive self, and the social, psychological, and physical selves as well. 

The formal and informal education youngsters receive in school are now 
recognized to be major . contributors to the maturation of their social and 
personal skills. Beane, Lipka, and Ludewig (1980) are but examples of 
scholars whose work attest to the fact that how youngsters see themselves, 
their self -perceptions, are . closely related to school factors such as 
academic achievement, school completion, and self-direction in learning. 
Thus, it is no wonder that professional educators are adamant in their 
belief that in order to understand fully how students evaluate themselves, 
their self-esteems, what also must be understood are the social and 
. psychological correlates of behavior found within and outside of the 
^aissroom. Also, because many children currently spend less, time with 
their parents, and more time .in day' care centers, it is now safe to assume 
that for many youngsters the school, has ,b3con.e as vital an institution as 
the family in determining how growing youngsters will value themselves 
and ih determining their attitudes of self-acceptance or self -rejection. 
It is no surprise, then, that the enhancement of students' self -perceptions 
has emerged as .a valued gpal" of American education.. 

The acknowledgment that the school environment does heavily impact on a 
youngster's, d^eve loping self-esteem has resulted in a proliferation of 
studies designed to tease out which school variables relate to the growth 
and development of a child's positive self-esteem. Examples of these 
Variables include social climate of the school, the physical structure of 
the school, teacher behavior, and availability of classroom materials. 
These studies have been conducted in various socio-economic-status 
settings, , with a variety of sub-populations, and under various research 
and practical conditions. 

The intent of this report was to build. these findings by examining which 
school variables are operative in the development of the self-esteem of 
students who attend predominantly (70%) Hispanic, Black, ^ Asian, and other 
non-Anglo (PHBAo) schools. The repjort sought to determine whether 
differences exist between PHBAO schools that were designated as high- 
scoring self-esteem schools, and those designated as low-scoring self- 
esteem schools. Also, an attempt was made to identify which educcitional 
practices relate to the high and low designations. Examples of specific 
areas examined at the high- and low-scoring PHBAO schools were (1) the 
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perceptions held by school staff regarding students' academic abilities, 
(2) the existence of mechanisms within the school which intrinsically say 
to students they are valuable human beings, (3) the presence of structured 
school activities which encourage and motivate students to be independent 
thinkers and to maximize their academic, social, and personal potentials, 
and (4) the implementation of academic practices that convey to students 
that education is meaningful and serves a definite purpose in their lives. 

METHODOLOGY 

Sample " - 

During the 1981-82 academic year the School Attitude Measu re (SAM), Scott, 
Foresman, and Company, 1980.. was administered to a group or fourth, sixth, 
and tenth grade PHBAO students. The SAM is designed to measure several 
dimensions of student attitude expression. Five attitude scales comprise 
the SAM. They include (1) Motivation for Schooling, (2) Academic Se;f- 
Concept: Reference Based, (4) Sense of Control Over Performance, and (5) 
Instructional Mastery. » 

The students taking the s'am came from 77 District elementary, junior, and 
senior high PHBAO schools. From this group were selected eight schools 
that would provide evaluative information for this report. Four were 
designated high^scoring self-esteem schools and four low-scoring self- 
esteem schools. The high-scoring schools were those, among the 77 
originally tested, with the highest local school ^^rcentile SAM scores on 
the instrument's J:ive subscales. Conversely, the low-scoring schools 
were those with the lowest local school percentile SAM scores. From the 
high-scoring schools were selected two elementary, one junior high, and 
one senior high school. A similar grouping was selected from the low- 
scoring schools. Hence, a total of eight sample schools wrre chosen. 

The next step was to identify three respondent groups fron? the sample 
schools. The first were 32 randomly selected teachers— four coming from 
each sample school. Second were the schools' eight principals... Third 
were 24 students, three randomly selected from each of the eight sample 
schools. in all, then, respondents for this report consisted of three 
groups— 8 principals, 24 students, and 32 teachers. 

Instrumentb and Data Collection Procedure s 

on-site observations and interviews were the assessment procedures used 
to obtain evaluative information for this report. Specially designed 
observation instruments and interview inventories were used. They were: 
1 . program Observation Sheet . A structured instrument designed to 

identify five areas which serve as the focal points for the on-site^ 
observations. TheiTwwe- (T) the school's physical appearance, 
(2) the affective quality of the school's auxiliary staff, (3) 
the type and quality of the lunchtime activities, (4) the security 
of the school, and. (5) classroom observations. 
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2. Principal inventory * A structured interview designed to obtain 
information concerning the school's demographic characteristics, 

and the principal's judgments about each school's overall appearance, 
the Jiumber of available support services, the types of parent 
activities, etc. ^ 

3. Teacher Inventory , A' structured interview designed to solicit 
teacher's judgmentis concerning the school's demographic character- 
istics and the teacher's opinions regarding topics such as school 
volunteers, parent activities, staff meetings, and the school's 
administrative leadership. 

4. Student Feedback s This brief inventory was designed to gather 
on-the-spot assessments fiom students regarding how much they liKed 
their particular school. 

Ail of the observations and interviews were, conducted on the grounds and in 
the classrooms of the eight sample schools. These activities were 
transacted by staff members of the Los Angeles Unified School District's 
PHBAO Evaluation Unit. In gathering this information, care was taken to 
maintain the anonymity of the schools and the respondents* 

^ • SUMMARY AND RECOMMENDATIONS . 

As previously mentioned, the purpose of this report was to ascertain which 
school variab3.es tend to be. assjD.ciated with the high or low self-esteem of 
students who attend predominantly (70%) Asian, Black, Hispanic, and other 
non-^Anglo (PHBAO) schools. Specifically, determinations were made regarding 
whether there are differences at the two school types with respect to specific 
educational practices and the attitudes held by staffs concerning students' 
educational progress and the schools ' instructional programs. 

TWO findings are worth noting.^' First, differences do exist at highland low 
self-esteem schools. Second, some of these differences are more likely to 
occur at the elementary, le*vel, while others are more .likely to occur at the 
secondary level. The^^ecific areas where disparities were observed are 
three. ^he first, involves the affective quality displayed by the schools' 
auxiliary staffs. Differences were observed at the elementary level but 
not at the secondary level. At the high self-esteem elementary schools 
there«s,was a greater proclivity for the schools' auxiliary staffs to display 
mocW affective behaviors than was found at the low' self-esteem schools. At 
, these high self-esteem schools the staffs were described as demonstrating 
what appeared to be a genuine care for students, they (the staff) were 
friendly (e.g., smiles) and helpful tpward other staff, students, and parents, 
and the staffs appeared competent and took pride in their work. Such, 
behaviors were not reported by the interviewers at the low self-esteem 
schools. A typical comment from observations made at the low .self-esteem 
schools was, "The office secre'^taries and cafeteria staff work with no smiles 
and are not too friendly toward students. The office personnel are always 
sitting. No one gets up too swiftly when students, parents, or staff come 
into the office." In general, then, the auxiliary staffs at the high self- 



esteem elementary schools were seen as "triendlier toward other staff members, 
more polite, knowledgeable, and helpful\to students, and characteristically 
maintaining a good rapport with all. 

A second area where differences were found at the two school types is 
associated with the schools' lunchtime activities, e.g., the cafeteria 
(size, organization, supervision of student^' behavior), the lunch benches 
(size, organization, supervision), and the ^dayground (available* supervision, 
character and style of supervisory personneA structured oi^^ unstructured 
activities, students' behavior)* The 'f inding^s show that there are differences 
in the lunchtime activities found at high and \ low self-esteem PHBAO schools 
at both the elementary and senior high levels) None were observed, however, 
at the junior high level. \ 

Typical descriptors of the high self-esteem eleWntary schools' lunchtime 
activities are that they are well organized, well supervised, and that 
there are disciplined students. Also, at these ^schools a workable number 
of students are serviced by the cafeterias, students very frequently lunch 
under covered areas (sunroofs), the students play in assicjned areas on the 
pl&yground, and the lunchtime supervisory staffsAare comprised of teachers 
nbbn aides, and college Students. In contrast, aW the low self-esteem 
schools it is not uncommon to see cafeterias too Somali to service its student 
population, inadequate supervision by staff, uncovered and physically 
unattractive eating areas, and the predominance of^ publicaddress systems 
to contrdl and supervise students. 



At the senior high level discernible differences we^e also noted with 
respect to lunchtime activities. At high self-esteem schools one would 
likely see cafeterias that are well supervised, adequately sized, and well 
equipped with chairs, tables, and trash cans.; ,^The Ipnch bench areas 
typically have covered pa villions, an ample supply of tables and benches, 
good supervision, and satisfactory sLudent behavior. \^ Lastly, on the 
playgrounds of the high self-esteem senior high campuBes are numerous 
supervisory staff members (security agents and aides, \deans, counselors, 
and administrators) who are highly mobile and maintained a high degree of 
visibility among the students. \^ 

The third area where differences were found at the two ^chool types was in 
the classroom themselves. While there were no dissimilarities at the 
secondary level, some were noted at the elementary levelV For example, 
with regard to the physical appearance of the classrooms^ classes at high 
self-esteem schools are generally neat, there is available instructional- 
material, there are learning centers in use, and there arft clean, cheerful 
.bulletin boards evident.. In contrast, at the. low self-esteem schools 
children mostly engage in paper-and-pencil activities, and\ there are few 
decorated bulletin boards, neat classrooms, 'or available iri^structional 
materials. Faculty restrooms are sometimes used as locations for learning, 
and in some classrooms there appears to.,be little learning d^r . teaching 
taking place. 

There were also contrasts in the behaviors of the students and the teachers 
in the classrooms of the two/school types. At the high self-esteem schools 
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students actively engage in classroom projects, at all times /the students- 
are busy with individual or group assignments, and there are /frequent 
interactions ketween students and teachers, with regard to teacher behavior 
at the high self-esteem schools the teachers interact" with students on a 
highly personal level, they (the teachers) appear highly competent in their 
subject matters, they exhibit a high degree of mobility within their 
classrooms, they give clear explicit directions to students/ they provide ' 
many teaching techniques in the implementation of their instructional 
programs. The behavior of the students and the teachers at/ the low self- 
esteem schools is markedly different. The students .are res'tless, highly 
mobile, and lack discipline. Many students can be observed daydreaming or 
just Idle in the classroom. m general, the students are Minimally involved 
with learning, and in some classes no instruction seemingly takes place. 
The teachers do not maintain close proximity to their students, and many of 
these teachers remain seated at^their desks throughout entlire class period. 

in addition to the previously mentioned three areas of difference, the high 
and low self-esteem schools were also distinctive with respect to their 
utilization of school volunteers, the number and types of parent activities 
ar.d teacher rationale for explaining job satisfaction. No discernible 
differences were noted, however, among the. high and low /self-esteem schools 
with regard to their physical appearances , ^school securities, playground 
equipment, support servic-s, administrative leadership qualities, or the 
attitudes of the administrators or teachers concerning, their school's 
instructional programs or their students' academic progress. 

Based on the findings of this report, the following recommendations are 
preoffered for consideration: 

1 . That there be a limited number of PHBAO elementary, junior, and 

senior high schools selected to serve as exi?erimental schools to 

'further study the vari'ables related to the ^elf -esteem of PHBAO 
students. - -, 

2. That efforts be made to provide incentives to PHBAO schools for 
the continuous maintenance and upkeep of the schools ' physical 
appearance, both internally and externally-. 

< ■ ; ... f , ■ 

3. \;<That auxiliary starfs be given inservice training designed to 

teach skills related to ^topics such as interpersonal communication 
and relationship development. 

4. That management consultant teams be sent to PHBAO schools in order 
to better organize and obtain maximum efficiency from the school's 
cafeterias and their staffs. / 

5. That all lunch bench areas be covered. ' 

6. That playground, cafeteria, and lunch bench-area supervisory staff 

^"-i^epth training on how best to implement quality student 
. supervision. 

7. That schools be equipped with an adequate number of lunch tabl°es and 
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chairs, trash cans, and playground equipment. 

<• * 

That teachers be in-serviced to upgrade their skills for improving 
classroom learning, for increasing student -participation, for 
bettering classroom supervision, .and for expanding their artistic 
repertoire to enhance the decor and visual attractiveness of the. 
classroom environment. 

That the services of school volunteers be channeled toward academi 
tutoring and remediation activities . 

That specific parent activities be mandated for all PKBAO schools 
and that they (the activities) be an integral part of each school 
yearly academic program. 
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CHAPTER VI; SUMMARY AND CONCLUSIONS 



This section summarizes the findings and, for clarity and emphasis, repeats 
the recommendations of the 1982-83 PHBAO evaluation. This information is 
presented in three areas based on initial evaluation objectives: (a) 
Program Effectiveness and Implementation Issues, (b) Description of Test 
Results, and (c) Amelioration of Harms. 

PROGRAM EFFECTIVENESS AND IMPLEMENTATION ISSUES 

In general, teachers and administrators rated the 19 PHBAO programs as 
effective in fulfilling their objectives. Specifically, it was perceived 
that the programs were effective in improving the quality of instruction, 
teacher morale, teachers' perceptions of, students' potential, student self- 
esteem, student achievement, and. parents' perceptions of the schools. The 
programs were not perceived as effective in increasing the percentage of 
students who graduate from high school. Interestingly, administrators 
viewed the programs more positively than teachers., 

It is recommended that: 

1. PHBAO programming as an overall thrust be continued, and 

2. Language Acquisition, Project AHEAD, and Computer Assistance be further 
reviewed with respect to participant perceptions of how consistently the 
programs meet their objectives. 

Seven of the 1 9 programs were specified by the District for more intensive 
implementation analysis. Conclusions regarding these programs are presented 
in terms of major program goals . 

Programs to Improve Teacher Quality 

The Bilingual Classroom Teacher, Program (BCTP) has made some very positive 
strides. Both teachers and administrators agreed that some of the immediate 
payoffs were (1) getting students to achieve at grade level, (2) ameliorating 
LEP students' apprehensi veness concerning their academic endeavors, and (3) 
assisting bilingual students in their quest for language and cultural 
acceptance. However, the respondents felt that the program's primary goal, 
to upgrade LEP students' English language proficiency, would only be realized 
on a long-term basis. Part of this concern related to the development and 
use of bilingual instructional materials. From teacher input in this area, 
it emerged that there is some confusion about the parameters of the BCTP as 
a PHBAO program and the District's overall bilingual program. 

- - It was also clear that the BCTP made a greater impact on retaining rather 
than on recruiting bilingual teachers at PHBAO schools. The salary 
differential was viewed as adequate by roughly half .of both the teachers 
and principals who responded. The work assignment time wa~5 r^port'^^^l as 
effectively used for a variety of activities, the most v^. L^ea of which were 
tutoring, counseling, and parent contact. Monitoring procedures for the 
program were highly variable among schools as were activities related to 
the needs assessment phase of the BCTP. 
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Recommendations for the Bilingual Classroom 'Teacher Program are : 

1 • That the District engage in public activities designed to provide 
greater visibility of the BCTP. 

2. That there be regularly scheduled meetings for personnel to exchange 
information and ideas regarding such matters as successful instruc- 
tional activities that can be implemented by .bilingual classroom 
teachers • 

3. That there be made available a greater surplus of non-English 
instructional material and textbooks. 

4» That there be time alloted for the preparation of non-English 
instructional material. 

5. That there be established a non-English curriculum library where 
teachers can secure needed materials. 

6. That there be established a formalized procedure for principals 
to use in the implementation of their school's bilingual needs 
assessment. 

7. That the District establish on-site observations to oversee the 
monitoring procedures used by individual BCTP schools. 

8. That there be a serious attempt to increase the number of bilingual 
teachers for specific subject matter courses for specific language 
groups . 

9. That there be a serious attempt to increase the salary differential 
for BCTP staff. 

10. That all staff, both teaching and non-teaching, receive intensive 
inservice regarding the goals and purposes of the District's two 
bilingual programs, the Bilingual Classroom Teacher program and the 
Bilingual Program. 

The Ur ban Classroom Teacher Program is progressing quite well, both 
procedurally and in terms of its overall goals. There is positive regard 
for procedures related to obtaining teacher commitments, to assessing school 
needs, and executing payroll. Teachers, however, are dissatisfied with the 
compensation in relation to the actual amount of extra time spent and with 
the differences in compensation among the three UCTP categories. 

Progr amma t i^palljv^^ 

activities most frequenty undertaken, and teachers report that tutoring is 
the single most beneficial activity provided. According to teachers, 
tutoring is provided consistently and is of good quality. Teachers also 
felt the program's most important aspect was the extra time they were able 
to spend with students. 



-50- 

57 

EKLC 



Activities related to school staff stability were not rated very highly* 
In particular, recruitment at the senior high level was not viewed as very 
effective and teacher absenteeism was judged to be about the same as before 
the program began. However, the overall quality of teaching staff was - 
perceived as somewhat improved, as was staff commitment. 

Recommendations for the Urban Classroom Teacher Program are ; 

1. That consideration be given to increasing the salary differential. 

2. That category distinctions be eliminated. 

3. That more effective methods be devised for recruiting and retaining 
staff. 

4. That methods be developed for reducing teacher absenteeism. 
Programs to Improve Curriculum 

The Computer Assistance and Curriculum Alignment Programs, and Project Textbook 
are all progressing well towards their goals. 

Computer Assistnce is viewed positively by both administrators and teachers, 
though there is a difference in the way that benefits are valued by both 
groups. Principals look to the Student Data System (SDS) to facilitate 
school management while teachers found the output from Computer Managed 
Instruction (CMI) as most useful and germane to their tasks. Both groups 
found the assistance provided by District staff and consultants to be 
extremely valuable. 

Respondent concerns focused on three areas. A universal concern was the 
need for more computer operator time. Additionally identified was the need 
for faster running programs and greater flexibility in programming so that 
individual school needs could be better met. Finally^ there was interest in 
increasing the ease of preparing system input as well as expanding scoring 
options. Several teachers mentcred the desire to learn more about the 
computer capabilities, suggesting that they could make better use of the 
output if they knew how to operjate the system. 

Recommendations for Computer As.sistance are ; 

1. That the program continue to be a priority for the target schools. 

. 2. That the programs" within the sub-sysi^em be exp^^ 

other student data, such as attendance and instructional packages, 
for subjects in addition to reading. 

3. That in future planning,^ consideration be given to the development 
of in-house programminig capabilities so that system capacity can be 
adapted quickly and easily to the particular needs of each school. 



4. That in-service focused on computer capabilities continue. 



5. That future planning include teacher training in the direct use of the 
computer so that they can input and retrieve information for their 
teaching purposes and thereby gain a greater appreciation for the support 
that the system can be to their teaching tasks. 

Curriculum Alignment is perceived as quite useful, but more so by those 
teachers who are new to the program. Those teachers in schools that have 
participated in the program for three or more years, though positive, are 
less enthusiastic about the alignment process. Directors of instructiqn 
expressed concern about the need for activities to support the development 
of instructional strategies to be employed once the alignment is in place. 
It appears then, that once teachers have mastered the fundamental steps in 
the alignment process and continue to use them as appropriate to sound 
instructional planning , 'then value of the activities as a "program" ceases 
to exist. The program is therefore viewed as time-limited. 

Recommendations for Curriculum Alignment are t 

1 . That the instructional planning process inherent in the program be 
offered to teachers at schools as a part of general school in-service 
and management on an as-needed basis, but not as a "program". 

2. That the District develop additional ways of assisting teachers to 
expand teaching strategies, once learning needs of students have 
been identified. 

Project Textbook has been quite successful in achieving its primary goal of 
insuring that all students have basic books, for each academic subject. As 
principals and teachers responded, however, it was clear- that they did not 
make a differentiation between the PHBAO project and the District's general 
textbook program. As seen by the respondents, the program has been less 
successful in its use of computerized printouts and centralized inventories. 
While most teachers felt the centralized inventory system made the process 
easier than three years ago, they still felt that it was not particularly 
helpful. And, while almost half of the administrators felt the computerized 
printouts were useful, most reported that the computerized system did not 
reduce paperwork. Teachers were most concerned about being limited to 
using a singe set of District approved basic textbooks, feelina that a 
common set of books could not accommodate diversity in stuu ^ ethnicity, 
interests, and achievement level. In general, parent involvement has been 
minimal and limited to receiving information about textbooks. 



RecommenJafeio Prop <e'dt Textbbokriaxe t 

1. That the District continue its successful efforts to provide each 
Student with basic books. ^ 

2. That the District designate a coordinator to explain the program's 
purposes and procedures, as differentiated from the general District 
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textbook program, and to obtain feedback about the project's progress. 



r 3* That the District consider the use of supplementary or auxiliary 
texts to supplement the basic books. 

4. That the District develop a plan for parent inyolvement or eliminate 
such involvement as a major aspect of Project Textbook, 

Programs to Provide Student Support - 

The two programs designed to provide student support — Student-to-Student 
Interaction and Supplemental Counseling — are progressing reasonably well 
towards their objectives. 

For Student^to-Student Interaction , the objective of reducing racial 
isolation is met, to some extent, by virtue of the activities that involve, 
mixed ethnic/racial groups. That is, students are taken from racially 
isolated schools to racially mixed activity situations, of the two major 
activities, camping appears more effective in promoting the second objective 
— promoting interracial/intercultural understanding — than Sea Education 
Afloat (SEA). SEA is considered intellectually stimulating, as it teaches 
students about the ocean and boats. However, there is no interracial/inter-^ 
cultural content. Camping, on the other hand, programs interaction games 
which teach about ethnicity, discriminationT personal values, and societal 
contributions of various ethnicr groups. - 

The third objective — the promotion of positive student interaction — is 
fulfilled in varying degrees by different activities. Pre- and post-activities 
contribute to the objective when , they engage students in sharing information, 
but not when they concentrate on directions and inf ormcCtion. SEA,. is seen 
as an effective intellectual program, but not effective in "promoting 
interaction. Camping is more effective in this area, though some of the 
opportunities in camping provide foj: intense activities whi'ch may inhibit 
interaction. 

Recommendations for Student-to-Student Interaction are : 

1. That the objectives of each activity be specified. 

• ^ * ■ ^ 

'2. That each activity ^incluc'o ^^..aponents wh,ich increase sturi^ . .:derit 
interaction . and/or studei. ' ' tjr interaction. 

3. That pre- and post-sessions be emphasized ^s part of ' the. Camping and 
— -SEA-aati vities ,~ e .g, ,^th^^ 

*of activities be made available, 

* - ♦ 

4. That Sea Afloat be revised to include activities that promote the 
program objectives or be drppped as a component of the, Student-to- 
Student Interaction program. 
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Supplemental Counseling is viewed favorably by students and counselors. 
Both groups held in positive regard the availability of counseling services 
made possible through this program to meet either expected or unexpected 
needs. The students reported that the greatest assistance was given in the 
area of articulation of specific course and graduation requirements. Matters 
related to career counseling received the least favorable comments. Students 
and counselors felt the maintenance of, students' records, improvement in 
students' achievement, increased parental involvement, and assistance in , 
the resolution of students' personal problems were all positive features of 
the program. 

With regard to implementation, there was considerable diversify'' among 
schools. There was a wide range of pupil/counselor ratios as ^ell as 
percentages of time spent by supplemental counselors doing "counseling 
duties". Variations were also noted in the use of individual or group 
counseling methods and in support given for' the whole-child approach. 

Recom mendations for Supplemental Counseling are : 

That there be an effort to determine, establish, and monitor the 
375:1 student/counselor ratio at each PHBAO senior high school. 

That there be on-site observations made of the Supplemental Counseling 
Program in order to aid individual PHBAO schools in identifying 
particular implementation problems, e.g., interruptions caused by 
irrelevant teacher referrals, and ultimately in resolving these problems. 

That there be an in-depth analysis of how the whole-child approach is 
implemented at each school and a determination made of the difficulties 
encountered. Where appropriate, mechanisms for providing assistance 
in carrying out the approach should be identified and procedures 
established for the utilization of such assistance. 

That there be clearly defined procedures established for the execution 
of career counseling, e.g., with Career counselors or with the on-line 
counseling staff. - 

Tiiat there be District sponsored in-service training to aid counselors 
in identifying and using the most expedient procedures for maintaining 
student logs, documenting contact with counselees, and reducing 
paperwork and clerical chores. 

That .here be an in-depth analysis focusing on ways to augment counselor 
time and to increase the number of available counselors for students. 



DESCRIPTION OP TEST RESULTS :> 

Study findings indicate slight improvements in self-concept and achievement 
at* the elementary levels. There is less improvement at the secondary level 
and all scores remain below the appropriate standard (i.e., either national 
or District norms). 



2. 



3. 



4. 
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The Student Attitude Measure (SAM) indicates that non-year-round 6th and 
10th graders were less positive than the national sample about their academic 
ability, school skills, and performance. Moreover, the PHBAO students 
scored lower on motivation for schooling than the national , sample • A 
definitive interpretation of these findings is beyond the data at hand, but 
it may be conjectured that: students who feel they lack ability may not be 
motivated to try to achieve, and the poor performance reinforces the notion 
that they lack academic ability* 

Non-year-round elementary students evidenced a slight improvement in motivation 
for schooling, performance based on self -concept, and perceptions of academic 
skills over the three-year evaluation period. These improvements, however, 
were not evident at the secondary level. Similarly, 6th graders at year- 
round schools showed a slight improvement over two years in terms of confidence 
in their academic abilities and feelings about school performance. 

The Survey of Essential Skills (SES) , administered at the. elementary level, 
indicates that reading and language test scores of 4th and 6th graders did 
not improve from the 1982 to the 1983 testing. However, test scores 
increased for math at both grade levels, and differences between 1982 and 
1983 scores were statistically significant. Moreover, there was a marked 
increase at both grade levels from 1982 to 1983 in the percentage of schools 
whose scores fell in the mastery range. Though there was a slight decrease 
in the 6th grade reading scores, the over-all 6th grade performance in 
reading did not fall out of the mastery range. 

The Comprehensive Test of Basic Skills (CTBS) , administered to 8th and 10th 
graders, yielded far less encouraging results. .? Though the overall gains 
made by 8th graders were small, those in the program three years made 
considerably greater strides in both reading and mathematics thc.n those 
only in the program two years. Senior high gains were miniscule. Present 
and past scores at both secondary grade levels were well below the 50th 
percentile. 

Recommendations Based on Test Results are ; 

1 . That test preparation and administration be carefully monitored, 
especially at the secondary level. 

2. Continued effort be made toward the improvement of basic skills 

of students that_ then can be reflected in improved achievement and 
attitude test scores. 
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AMELIORATION OF HARMS 

We were unable to identify practices which consistently distinguished high- 
and low-scoring schools on achievement, post-secondary access, interracial 
hostility and self-esteem. What did emerge, however, was an interesting 
relationship between the amelioration of harms and staff attitudes, 
expectations and interactions with students. The following highlights 
those trends as well as those idiosyncratic to the assessment of the 
amelioration of each harm. 

Achievement 

At the high achieving schools, classes tended to be smaller, students spent 
more time on-task, tea^^ers interrupted classes less frequently for 
disciplinary purposes, students had fewer absences and teachers, at the 
elementary level, were absent-Uess frequently. Administrators and. staff at 
schools with higher scores seems to be focused on activities over which 
they had some control (i.e., educational programs) while those in lower 
achieving schools were more concerned about things external to the school 
(i.e., gangs,, lack of community support, etc.) At higher achieving schools, 
teachers are far more positive about student' behavior , achievement, and 
capacity to learn than at lower achieving schools. 

Recommendations for the Am^^lioration of Harm: Low Achievement are : 

1 . That the District continue to focus on improved instructional strategies 
and classroom management. 

2. That there be continued emphasis on and support given to teachers 
toward the enhancement of expectations of students. 

3. That in those low achieving schools surrounded by difficult socio-cultural 
conditions, greater attention be paid to teacher and administrative 
supports in order to nurture and maintain positive attitudes as they 
relate to student performance. 

Post-Secondary Access , . 

School practices that clearly distinguished those schools with high percentages 
of students seeking access to post-secondary opportunities and those with 
low percentages were nc> discerned. Student visits to arrange of educational 
institutions, availability of information and opportunities for student 
leadership were comparable in ,)30th sets of schools. What was different, 
however, were the attitudes and expectations of school staff. Teachei;s, 
principals, and counselors in schools with high post-secondary access were . 
more knowledgeable about student plans, about the college, attendance of 
students' families and peers, and about the quality of information provided 
the students than werie staff in the low-access schools. Moreover, teachers 
in the high-access nchools were more involved in promoting and encouraging 
students' post-secondary activities than teachers in the low-access schools. 
We conjecture that this involvement manifests itself in a greater level of 
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support which nurtures student aspiration and subsequently student plans to 
seek post-secondary opportunities • 

Recommendations for the Amelioration of Harm; Lack of Access to Pos t- 
S econdary Opportunities are ; ' 

That sta5f development at the high school level emphasize the importance 
of teacher support and positive expectations for increasing students' 
access to post-secondary opportunities. 

That in addition to making college/business literature available to 
students, teachers as well as counselors be encouraged to be more 
interactive with students in interpreting information provided. 

That schools begin to identify more effective means of obtaining 
parent involvement in Career Day activities and post- secondary infor- 
mation exchanges. 

That as indicated by school staff, visits to colleges/businesses 
coul^ be improved by having better student transportation, by 
scheduling visits during non-class hours, and by increasing the 
number of student participants. 

That major post-secondary access activities increasingly focus on 
sophomores and juniors, in addition to seniors. 

Interracial Hostility and Intolerance 

Teachers also play an important role in ameliorating the harm of interracial 
hostility and intolerance. In schools with lower levels of interracial 
hostility, teachers focused on positive aspects of ethnicity with their 
students. Teachers in these schools were seen as more frequently reinforcing 
the worth of all students than were teachers in the high interracial 
hostility ; schools. All schools had deterrence systems. But those in the 
low hostility schools were more modest, tended to focus on interpersonal 
strategies, and clearly directed the engagement of students in intense 
academic activities which served to equalize the status among the students.- 
Those schools with high hos'tility tended to rely more heavily on rules and 
regulations to avert overt conflict and in one instance created a structure 
in which two distinct ethnic student groups co-exist in parallel social 
. systems • 

c 

Recommendations for^the Amelioration of Harm; Interracial Hostility and 
Intolerance are ; * 

•1. That schools continue to implement deterrence systems (parallel 
students • groups are not to be considered legitimate). 

2m That deterrence systems include activities integrating faculty, 
staff, and students throughout the school organization. 
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3. That deterrence systems be varied in activities and intensity. PHBAO 
programs such as Student-to-Student should be expanded. 

4. That schools become aware of various kinds of successful deterrence 
systems. 

s 

Self-Ksteem 

In schools which scored high on self-esteem, auxiliary staff (office 
secretaries, cafeteria workers) interacted quite positively with students. 
Moreover, teachers in high self-esteem schools were found to interact more 
frequently with students during non-class time and transition periods than 
teachers in low self-esteem schools. Differences in lunchtime activities 
were noted, wit^ the high esteem schools being characterized by cafeterias 
and playgrounds of a size to accommodate the student body, by adequate 
amount and arrangement of equipment and by adequate supervision. The 
physical appearance of classrooms in high esteem "schools was neat, clean 
and cheerful in contrast to those of low esteem schools. Classroom activity 
in the high esteem schools were arranged so as to actively engage the 
learner. In the low esteem schools there seemed to be greater reliance on 
pen and pencil type activities, parent activities were planned by 
administrative personnel in the high scoring schools while this function 
was relegated to special interest groups in low scoring schools. And^ 
finally, in the high scoring schools, volunteers were, used more often as 
tutors, whereas the low scoring schools used them more often as clerical 
aides or for yard duty. o 

Recommen dations for the Amelioration of tfearm; Low Self-Esteem are ; 

That there be a limited number of PHBAp elementary, junior, and 
senior high schools selected to serve as experimental schools to 
further study the variables related td the self-esteem of PHBAO 
students. 

That efforts be made to provide incentive to PHBAO schools for the 
continuous maintenance and upkeep of the schools • physical appear- " 
ance, both internally and externally. 

That auxiliary staffs be given in-service training designed to teach 
skills related to topics such as /interpersonal communication and 
relationship development / 

That management consultant teams be sent to PHBAO schools in order 
to better organize and obtain maximum efficiency from the school •s 
cafeterias and their staffs. 

Tl'Aat all lunch* bench areas be covered. 

That playground, cafeteria, and lunch bench-area supervisory staff 
be given in-depth training on how best to implement quality student 
supervision. 



1. 

2. 

3. 

4. 

5. 
6. 
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?• That schools be equipped with an adequate number of lunch tables and 
chairs, trash cans, and playground equipment • 

8. That teachers be in-serviced to upgrade their Skills for improving 
classroom learning, for increasing student participation, for 
bettering classroom supervision, and for expanding' their artistic : 
repertoire to enhance the decor and visual attractiveness of the 
classroom environment. 

9. That the services of school volunteers be chan\ie led toward academic- 
tutoring and remediation activities. ' 

10. That specific parent activities be mandated for all PHBAO schools' 
and that they (the activities) be an integral part of each school's 
yearly academic program. 



CONCLUSIONS 

This team feels that over-all, PHBAO programming is TOrking well and should 
continue, with the recommended modifications. As a Significant thrust in 
the District's educational design, the importance of staff expectations of 
students permeates most all of the findings of this study. What needs to be 
underscor,ed is that these expectations affect students in areas other than 
achievement. 
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THE MED-COR PROGRAM 



Med-COR has been operating for more than a decade. During that period, 
the program has consistently improved, and the clientele it serves has been 
changed to include more junior high ^ school students. By increasing recruitment 
efforts in the direction of younger students, Ked-COR staff reasoned that the 
remedial and ^support aspects of the program will increase the potential for \ 
success. Evaluations have shovm that since ,the shift to acquiring participants, 
at an earlier age, a smaller percentage of students has dropped out of the pro- 
gram. 

Med-COR continues to be a part of the District's effort to "reduce and ulti- 
mate ly^ remove consequences of racial isolation." Med-COR embraces three specifi 
goals of Court -approved PHBAO programs by providing students opportunity to im- 
prove self-esteem, to improve levels of academic achievement, and to increase 
access to post graduate educational and employment opportunities. \ 

Sufficient evaluations have been done to establish that Med-COR is. a succerfs- 
ful program and that it is accomplishing its major objectives at a very acceptable 
level. The 1982-83 evaluation, therefore, concentrated on monitoring the contin- 
ued attainment of its goals and, in addition, attempted to gather input from 
Med-COR students on how to improve program efforts to meet student needs. 

This is an abstract of the 1982-83 evaluation covering the summer program, 
the Saturday program, and a follow-up of the June 1982 and June 1979 Med-COR 
graduates. 

SUMMARY OF FINDINGS 
Status of 1982 Graduates 



1. Ninety-five percent of the Jung 1982 graduates are enrolled in an institu- 
tion of higher learning. 

2i Seventy-seven percent are enrolled in four-year colleges, and 18% are 
enrolled in. ^two-year colleges. 

3. Ninety-seven percent of the graduates who are enrolled in college have 
decided on a career. 

4. Eighty-four percent of those who have decided on a career have chosen 
a health-related career. 

' ■ '■ ' ' 

'■;•>- • ■ 

5. Of the 13% who have not chosen a health career, two plan to be in compu- 
ters, two in business, and one in language interpretation, all of which 
could relate to health. 

i 



6. A 1982 Med-COR graduate's chances of enrolling in college were much better 
than that of graduates of participating schools (95% compared to 58.6%). 

7 A higher percentage of Med-COR graduates enrolled in four-year colleges 
than graduates of participating schools (76.7% compared to 38.5%). 

8. Almost half of the 1982 graduates who are pursuing college degrees are 
majoring in biology (37%) or nursing (11%). 

Status of 1979 Graduates 

1. Seventy-seven percent of the 1979 graduates of Med-COR are still 
enrolled full-time in college. 

2. Sixty-seven percent are enrolled in a four-year college and an additional 
10% are enrolled in a two-year college. 

3 Fifty percent of those enr9lled full-time in school reported that they 
held class status as seniors, 28% as juniors and 17% as sophomores. 

4. Sixty percent of the students enrolled full-time in college are pursuing 
a health -re la ted career. 

Summer Program 1982 



Hospital Experience 

1 participants thought the best thing that happened to them in the summer ■ 
experience was to discover that they could take on a new task and be 
successful and useful. 

2. .As a result of the experiences in the hospital, students developed self - 
' Confidence and a belief that they could do something important in life. 

3. Eighty-six percent ot students interviewed, who had experienced two 
summers of hospital work, said that as a result of the experience they 
decided on a career. 

4. Along with discovering career areas of interest, many students discovered 
areas in which they decidedly did not want to work. 

5. self-confidence grew slowly as revulsion for certain activities diminished 
with experience and with success as a result of staff encouragement, 
patience, and understanding. 



6- 



participants had few suggestions for improving the summer program, but 
they mentioned several areas of personal interest where they would have 
liked more experience if it were offered. 
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Most students thought .their assigned activities were wide and varied enough 
to help them make a career choice. 



Students were complimentary about the role played by doctors, nurses, 

and patj.ents in making their " experiences successful and in helping "tHem ~ 

feel needed and useful* 

Participants have difficulty analyzing their hoispital experience critically. 
They react to their summer experience in mostly quantitative terms and 
little in qualitative judgments. There was little about the summer experi- 
ence that they think not worthwhile. 

The summer program in 1982 involved less than 30% of the total number of 
students enrolled in Med-COR. 

Enrollment is currently limited to senior high school students who qualify 
for the Youth Employment Program. 



S.A.T. Improvement Program 

1. The average improvement in mathematics was 40 points. 

2. Twenty of the 28 students improved their scores in English • 

3. The average S.A.T. scaled English score improved 50 points. 

4. Nineteen of the 28 students improved their scores in* mathematics . 

5. Seventeen of the 28 students improved their scores In ^both subjects. 



Saturday Tutorial Prdgram 
Holding Power 

1 . Most participants who leave the Med-COR program do so because of other 
interests or responsibilities they have on Saturday. 

2. Most participants who left the program in 1982-83 still intend to attend 
college and pursue a health related career. 

Attendance 

1. Staff efforts to improve attendance were successful in 1982-83. 

2. Attendance was not only greater than in the three pr:evious years, but it 
was also more stable. 

Test Results 

1. Both junior high school and senior high students failed to show much change 
in their ability to use English la}iguage skills. Each of the groups re- 
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gistered only a 7% mean gain. 

The senior high school group registered their ^"^^^^Vf tiLb^a'^ifr 
matics. in Algebra I the group had an 81% mean gain, in Algebra II a 
146% mean gain, and in geometry a 175% mean gain. 

3. Junior high school students also did well in mathematics showing gains 
of 20% in pre-algebra. 139% in algebra and 228% m geometry. 

4. in science the senior high school group made moderate gains of 50% in 
biology and 66% in chemistry. 

5. The junior high school group , accomplished very l^^^^-^^^J^^^'" ^^J^' 
exhibiting a 7% mean gain in introductory biology, and an 11% mean gain 
in general science. 

Student Opinion - Senior High 

1 senior high school students, when interviewed, stated that instruction 
fn English skills would be more helpful if taught through practical use 
of the skills in/ writing and speech, 

2. The students re/orted that instruction in Er.glish -^i^^^/^^^^^ 
siderably in coftent and method from one instructor to another. 

3. 



4. 



in mathematics,! most senior high school students felt that the instruction 
they recaived^^was meeting their needs, 

interest m icience was high among the senior ^^^9^ -f ool ^Jj-^^^--'- 
but they thought that unequal opportunity is available ^to all students 
- to receive lab'oratory experience in biology and chemistry. 

5. Students that did receive laboratory experience : were very positive 
about the value of the experience. ' • 

6. senior high school students thought that mathematics was the most inter-, 
esting Saturday class and English the least interesting. - 

Student Opinion --Junior High 

1. Most junior high school interviewees thought that instruction they re- 
ceived in English skills was helpful. 

2. 'The students approved of the three group separation of students in accord- 
ance with their individual needs. 

■X students would like to see games, oral reviews, or essays used in English 
instruction to give them mo're opportunity for active participation in 
the learning process. 



4. Junior high school students were pleased with the help they received in 
. mathematics. They felt that compared to their home school instruction, 

Med-COR offers more opportunity to ask questions and review a problem 
a second time • 

5. They would like . to have even more time available for explanation, asking 
questions, and review. 

6. Junior high school students liked the help received in science, but 
would prefer less lecture and more laboratory and discussion opportunity 

?• Junior high students thought Med-COR science classes the most interesting 
and English classes the least interesting. 

CONCLUSIONS 

The following conclusions can be drawn from the findings of this part of 
the 1982-83 evaluation: 

The Med-COR program is meeting its major goal of helping students to be- 
come qualified for and to be accepted by colleges and universities. 

The Med-COR program is meeting the following three specific goals of the 
Court approved PHBAO programs: (1) providing students an opportunity to im- 
prove self-esteem, (2) improving levels of academic achievement, and (3) 
increasing access to post-graduate educational and employment opportuni- 
ties. 

The Med-COR program is successful in motivating participants to prepare 
for health-related careers. 

4. The extraordinary and consistent success of Med-COR graduates in qualify- 
ing for and pursuing advanced education is ample evidence that the pro- 
gram is doing much to reduce and ultimately to remove,,. the coneoquences of 
racial isolation. ,^ ■ i 

The high percentage of students still enrolled in college four years 
after graduation from Med-COR (1979) is evidence of the lastj^g positive 
effect of the Med-COR experience. 

The percentage of students enrolled in college four years after gradua- 
tion from Med-COR and holding class status as juniors (28%) and sopho- v 
mores (17%) indicates that Med-COR graduates whose academic and 
career goal pursuits are temporarily interrupted continue to pursue 
those goals. ^ 

7. Both test results and student opinion point to the need for change in 
the way' English instruction is now provided if satisfactory student 
academic gain is to result. 

8. Med-COR students recognize the value of being more actively involved 
in the educational process if maximum learning is to result. 
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RECOMMENDATIONS ' 

^ 

Since the summer program is a vital and necessary experience through 
which the Med-COR program can reach its. goals, the opportunities to 
participate should be expanded and made available to a .Tiuch larger 
portion of those enrolled. All students are provided the opportunity 
to volunteer during the surtimer but few decide, to do so. Most students 
are interested in summer work and money has not been generated to pay. 
them. The sole source of funds available to Med-COR is :the Summer 
Youth Employment Program (SYEP) which limits participation to the 
poverty guideline. The primary restriction to greater participation 
r'emains the limited number of Med-COR students who qualify for SYEP 
participation. Sponsoring agencies should, therefore, jointly explore; 
sources of non-governmental' funds in order to broaden the paid work 
experience opportunity. 

Staff should e:cplore ways of more actively involving students in the 
educational process. This is most needed in the subject area of English 
and is seen by students as lacking in most classes. Steps should also 
be taken by staff to monitor as: well as encourage the provision of more 
opportunity for student involvement in the educational process. The 
implementation in 1982-83 of staff review of lesson plans of instructors 
was a positive step. Nevertheless, the continued use by some instructors 
of lecture and drill to the exclusion of learning activities that more 
actively involve students in the. learning process is not in the best, • 
interests of reaching the academic goals of the program. 

Because of the possibility of considerable variation in the number of 
students tested from pre to post, a different analytical treatment of 
test scores in subsequent evaluations is recommended. 
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EXECUTIVE SUMMARY 



School Readiness Language Development Program 
A Prekihdergarten Program for 
Predominantly Hispanic, Block, Asian, and Other Non-Anglo PuplU 



Poulo Moseley, Temporary Advisor 



Introduction 

In 1977, the Los Angeles Unified School District inaugurated a .student 
integration plan titled Integrated Educational Excellence Through Choice to 
alleviate the adverse conditions associated with segregation. The court 
approved the School Readiness Language- Development Program (SRLDP) component' 
in spring 1979. This prekindergarten project was designed for predominantly 
Hispanic, Black, Asian, and other non-Anglo pupils. Pupils aged 3 years 9" 
months' to 4 years 9 months and their parents attended classes. The pupils' 
instrktional program emphasised increasing the children's concept develop-' 
ment, listening, speaking, vocabulary, and comprehension skills. The parent 
classes focused on language development, physical development, nutrition, 
health and safety, emotional and'social development, discipline, intellectual 
development, and learninq experiences at home and away from home. 

Findings 

The technical report centered around 10 evaluation questions that ' 

included both implementation and progress data. The results are summarized 
in this section. 

In fall 1982, 121 programs operated in 98 schools. Twenty-three schools 
had 2 programs. Eight schools implemented new SRLDP classes in the fall. 
During the second semester, one program was added making a total of 98 
•schoo^ls, 122 programs, and 24 schools with 2 programs. 

The 1981-82. year-end report listed seven recommendations. Most of these 



j;;ecommendat^ nto-effect-during~tfTe~l982-83 school year i ncl udi ng : 

cons^i^stentjcon^^^ 
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Inventory Class Profile and the Individual Pupil Profile; providing 
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stai. develoH^^.it sessions on c — tioning skills, parent education and 
bilingual techniques; revising the parent education curriculum; conducting 
a longitudinal study of former SRLDP participants; and allowing parent 
instructors to teach approved topics not included in the curriculum. 

During 1982-83 SRLDP organizational changes included program expansion, 
curriculum modifications, steering committee alterations, and parent educa- 
tion program revisions. The changes improved program implementation and 

efficiency, ' 

The children included in the Cooperative'''Preschool . Inventory testing 
sample made great progress. The test data were analyzed according to 
language and sex using a mean percentage correct score. Both English and 
Spanish speaking pupils improved markedly from pre to post — 26 and 33 
percentage points respectively. Using median scores, the test results 
were grouped by age and language for comparison with national norms. 
Children pretested in^ English scored at or above the 63rd percentile in 
all age groups. Children pretested in Spanish scored at or above the 
62nd percentile. On the ppsttest, both English and Spanish speak.ing pupils 
scored at or above the 97th percentile. 

Survey of Essential Skills test results from former SRLDP pupils 
provided longitudinal data. In reading, the mean percent correct for 
former SRLDP first grade pupils was the same as the district score, and 
pupils from SRLDP schools with no preschool experience. Former SRLDP sc>cond 
grade pupils, scored higher in reading than both the total district, and 
pupils with no preschool experience. Former first grade SRLDP pupils did 

he-tter„i n„ma.theraa-ti.cs_than-the- di str i ct as_a whol e , but -scored lower- than ; 

the sample. Grade two SRLDP pupils, pupils with no preschool experience, and 
the-di Strict, received the same mean percen^^ . - 
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In composition, forner first grade SRLDP pu;.n'ls received the same 
e as the comparison groups. In grade two, former SRLDP pupils scored 
higher lmu, pupi s with no preschool experience, but lower than the 
district total . 

The parents indicated that the objectives of the parent classes were 
"covered and described the classes as informative, useful, and beneficial. 

The steering committee incorporated the information provided by the 
staff needs assessment when organizing the staff development sessions. 
The participants-appeared generally satisfied with the quality of the 
district staff development meetings although the ratings\were lower than 
last year. . ^ 

Teachers, education aides and teacher assistants, parents, parent 
teachers, and region advisors completing questionnaires expressed positive 
attitudes cbout the SRLDP. In summary, the SRLDP accomplished its goals 
.to provide appropriate learning experiences for pupils and parents. 

Recommendations • ' 

For continued positive program growth, the following recommendations 

i / 

were made: include parent education, parent' volunteers , auditory discrimin 
ation and memory skills, and social studies techniques in the staff 
development meetings; survey education aides and teacher assistants for 
staff development suggestions; expand the type of information collected for 
longitudinal study; .rotate_p_arent education schedule; and prepare a " ; 
correlation of required curriculum materials wi th~"thV"revi sed SRLDP 
Prekindergarten Skills Inventory. • : 
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PROLOGUE 

This report\^ been prepared as part of a two-year effort to evaluate 
the Voluntary Integrqtion and Year-Round Schools (YRS) programs for the 
Los Angeles Unified School District (LAUSD). The report is intended to meet the 
requirement Imposed by the Court Order of September, I98U Specifically, the 
Superior Court ordered, the^ Los Angeles Unified School District to provide by 
July 15, 1983 "...a full report of the measures taken and achieved under its 
voluntary integration plan." In response to this mandate, our studiesChave 



focused on both elements. Wit(i respect to "measures taken" we have considered 
tm? implementation of programs^as well as the actions taken by the LAUSD in 
response to earlier findings of the Evaluation Planning Team (EPT). We base our 
judgments on the "results achieved" on the District's progress In ameliorating 
the harms of roclaj isolation as reference'ci in the original Crawford report. 
Our judgments of the District's efforts on both Implementing 'measures and 
achieving resOlts ore based on multiple data sources. Quantitative and 
interpretive data from earlier reports and from the current year's studies are 
of course, important inputs. Inj addition ^ these data are compleriiented by our 
own interviews, discussions, and professional judgments ba^ed on three years of " 
examining the Voluntary Integration and Year-Round Schools programs. 

The Evaluation Planning Team members were originally invited to porticlpate ^ 
in the LAUSD evaluation efforts under the mandatory desegregation plan, the' 
relationship of the Team to the District has been complex. The identification 
of issues has been shared by the team, and LAUSD. The development and design of 
specific ^evaluation questions, methodology, and instruments hove been 
prerogatives of the Evaluation Planning Team, in consultotl^on with District 
personnel. Data collection has been conducted using LAUSbx^personnel and 
personnel of neighboring universities, as well us the Team members, the 
analyses, interpretations,, and recommendations for this report, as our earlier 
reports, represent the work of the Team members. Throughout, we hove worked 
within the constraints of resources, time, personnel , and information bases. 



Context 

In our work, we have become especially aware of the importance of 
context in the analysis and interpretation of findings; particularly so 
because our process has extended over a number of years, and we have found 
that assumptions, points-of-view, and facts change over time. 

Let us consider the context in three parts: I) the nature of the greater 
Los Angeles Area served by the LAUSD, 2) the changes in LAUSD, and 3) the effect 
of State and Federal policy changes on the operations of LAUSD. 

The Greoter Los Angeles Area. The area serviced by LAUSD is a clear factor 
in any District study. Its boundaries include square miles, within which 
could be placed the combined areas of all of Boston, Cleveland, Denver, 
NAanhattan, Milwaukee, Philadelphia, Providence, and Washington, D.C. The 
District serves all of the city of Los Angeles, seven other incorporated> cities, 
and portions of 18 other municipalities. The city of Los Angeles is more than 
50 miles across at its widest point, split by the Santa Monica Mountains. The 
San Fernando Valley alone, with an area of 235 square miles and a population of 
1.5 million, is second only in size to Los Angeles in California and seventh in 
population in the country. 

DemographicaM.y, the Los Angeles area is enormously diverse. Seventy 
language groups (requiring ,bi lingual attention) are represented in the District. 
The majority of students in the District come from Spanish speaking 
environments, many from families of Mexican descent. There are, as well, 
substantial numbers from other Latin American countries and a small but growing - 
population from. Asia. The demographic changes in the area have been dramatic in 
the last decade and have strongly influenced the District's educational efforts. 

The size of the Los Angeles region, in part, has created sets of intact 
cbmmunities, many with the appearance of insuldrity. Rather than a single city 
. .:*u „ ^( c.'.Ki.rKr.p a'-*»a« ' Anneles is more like a confederation of 
communities. Newer immigrants tend to settle in older parts of the city near 
families of similaH backgrounds, although the San Fernando Valley has 
substantial new immigration as well. Residential housing patterns have 
developed based on the initial location of immigrants and on the dominance of 
Anglo populotion; in the San Fernando Valley . Although one would expect 
residential distinctions to reduce over time, the high property, values in the 



-2- 



.0 

83 



area with other factors have mitigated against substantial population shifts and 
natural integration of racial and ethnic groups. These population patterns 
result in school areas in some parts of the District that are overcrowded while 
others are underpopulated. 

Context of LAUSO. Because the scope of effort and public concern is 
normally broad, we will consider only a few contextual factors (listed below) 
which have impact on the processes of the Voluntary Integration and Year-Round 
Schools programs and the District. 

. The leadership in LAUSD has changed during this period, permitting the 
new Superintendent to define his own program goals, activities, and 
relationships with the LAUSD Board of Education, staff, and with other 
constituencies. 

. The schools have experienced some of the same financial 
constraints felt by other public sectors since the tax 
reform efforts , culminating with Proposition 13. Thus, 
the District has been required to notify substantial ^ 
numbers of teachers that they might not be rehired because 
of fiscal limitations. 

. Paradoxically, almost throughout, a teacher shortage has 
existed in mathematics and science. 

. The racial distribution of the District in 1982-83 
included about equal proportions of Black and Anglo 
students (22% each), about 8% Asian, and approximately 
^9% Hispanic students. More than 544,000 students (1982-83 
figures) are taught by teachers in 826 schools. 

Sta^e and Fe<terol Context. Education has been topica! throughout the last 
few years with attention given to funding bases, student academic performance, 
educational equity and educational quality as central issues. Policy changes in 
available funds for categorical prpgrams reduced the amount of federal support , 
to LAUSD in 1982-83. The Serrano suit deliberations have resulted in the use of 



"per pupil costs" as a proxy measure of educational quality. The decision has 
also increased the State's interests in influencing local school districts. 
California's 1982 election sharpened the issues related" to the role of State 
leadership in education, and focused attention on performance and academic 
preparation; 

Nationally, the question of educational quality has also been roised by the 
Federal Commission on Educational Excellence and by other national reports 
assessing the quality of schooling. The concern for educational quality has 
been directed mainly at student performance shown, ^ r instance, by tightening 
requirements for admission to California universities and by -systems of 
statewide assessment and proficiency testing. In California, as in some other 
states, the educational quality issue has been extended to teachers through the 
administration of iskill tests for teachers in areas termed "basic" literacy. 
Further reports in national media have raised questions about the quality of 
people entering the teaching profession. There has been less rhetoric and 
attention, both state-wide and nationally to the issue of educational equity or 
the specific concern about the education of minority students. The joint 
concerns of student and teacher performance have led to some positive movement 
in increasing: 1) the expectations for students, 2) the meaning of grades, and 
3) the basic skill requirements at the local level. It is against the general 
context of these social facts and orientations that this report is presented. 
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Magnet Prograrm: Evaluation Sinnmory 



This summary describes a two-year evaluation of the Magnet programs 
operating in the Los Angeles Unified School District (LAUSD) that began in 
1981 • The evaluation, was conducted by the Voluntary Integration Evaluation 
Planning Tean» in collaboration with the Research and Evaluation Branch of 
the District. A separate report follows this summary which describes the 
history and nature of the Magnet programs, the methodology used to conduct 
the study during 1982-83, and the results of the study organized around the 
primary evaluation questions developed for the study. A similar report is 
available for , the 1981-82 study as well. 

This document is intended as a synthesis of the two-year evaluation 
effort. It provides a brief discussion of the context in which the 
evaluation took place, the methodology used to conduct the study, and the 
major findings and recommendations formulated by the Team, These findings 
and recommendations are based on the results of formal data collection 
activities as well as the professional judgments of team members based on 
extensive interviews and observations conducted informally over the course 
of the study. 

Context of the Magnet Program Evaluation 

The Magnet programs were established by the District in 1977 as part of 
its Voluntary Integration programs^ The goal of the programs was to 
establish and maintain' programs with specialized curricular offerings that 
would draw students of various ethnic backgrounds thereby creating 
desegregated learning environments. 

Mqgnet progrGms ore organized as either full scnooi magnets or Qs 
smaller magnet centers located on the campuses of regular schools. Each 
Magnet program is developed around either a specialized subject matter area 
such as math/science, performing arts, or business, or a specialized 
instructional approach such as fundamental or alternative schools, or 
students with particular needs such as gifted or highly gifted students. 

The District commissioned the Evaluation Planning Team to cop'''Jct an 
on-goJng evaluation of Magnet programs in 1981. At this time, the District 
was undergoing a change from a court-ordered mandatory desegregrotion 
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program to o voluntory desegregotion progrom of which the Magnet programs 
were one component. The Superior Court ordered the District to provide ... 
"a full report of the measures taken and results achieved under its 
integration plan." To this end, the study examined the implementation of the 
programs to determine whether processes were in place that supported the 
goal,of the programs^, that is, to provide a mechanism for encouraging 
voluntary integration through specialized educational offerings. Further, 
"results achieved" were examined by assessing the exte^it to which progress 
was being made in reducing the four harms of racial isolation identified in 
the Crawford case: achievement, attitudes toward school, post-secondary 
opportunities, and social interaction among members of different ethnic 
backg. ounds . ' 

The nature of tiie District itself and the changes experienced over the - 
past three years have made the implementation of Voluntary, Integration 
programs, such as the Magnet programs, and their evaluation difficult and 
complex. As described more fully in the Prologue, the District is extremely 
large, both in the rjmber of students served and the geographic location of 
its schools. The student population is ethnically and linguistically 
diverse. Further, there ore sets of intact cqmmunities in the-Lps Angeles 
region populated by particular racioLond ethnic groups . In addition, the 
racial/ethnic composition of the District is changing in such a way that 
Block and White student enrollments are decreasing, as Hispanic enrollment 
increases. These population patterns . result in school areas in that sortie 
ports of the District ore overcrowded while others ore underpopulated. 

Numerous other changes occurred during this period as well. The 
leadership of the LAUSD changed with the appointment of a new 
superintendent. The membership of the school board also shifted with the 
election of new members during this period. Financial .and budgetary 
constraints continued in the woke of tax reform efforts. Finally, the focus 
and requirements of the Court shifted as the District moved from a mandatory 
to a voluntary plan for desegregation in the District. One important aspect 
of this shift for the Magnet programs was a court order allowing the 
establishment of Magnet programs on the campuses of predominantly Hispanic, 
Block, Asian, and Other non-Anglo (PHBAO) schools. In response to this 
directive, the program sow considerable expansion with the establishment of 
thirteen new senior high magnets in 1981-82. 



Methods 

The study design employed a. mul ti-level , multiple method approach 
relying on a population census and more indepth data collection on a sample 
of programs from a variety of data sources and respondents. The paragraphs 
below briefly describe our strategy for sampling, instrumentation, and data 
collection and analysis. (For a more complete description, see Chapter II of 
the following report.) 

A three-tiered strategy was used to sample Magnet programs for study. 
First, all Magnet programs were included in a census involving the 
collection of limited demographic information about school characteristics 
and student enrollment. Second, a stratified random sample of Magnet 
programs was selected for the examination of program processes and outcomes 
This sample was designed to insure that programs were included in the sample 
that varied on three dimensions: type of program (content-oriented, 
process-oriented, or special population), racial/ethnic composition 
(desegregated or racially impacted), and grade level configuration 
(elementary, junior high, senior high, or extended). Third a sub-sample of 
the desegregated programs was randomly selected for observations of 
intergroup interaction. Furthermore, during 1981-82 a sample of new senior 
high programs was selected .for a sub-study of program fidelity; and, 
students and parents were selected from q sample of programs for a sub-study 
of their understandings of the inteqratibn programs. 

Formal data collection relied on a Variety of methods and respondents. 
District records were abstracted for information on schools and student 
enrollments. District- program administrators were interviewed about 
program policies and procedures. Questionnaires were completed by site 
administrators, teachers, and during 1982-83, college advisors. Students 
at target grade levels (grades 5, 6, 8, 10) completed a measure of attitudes 
toward school. Achievemerrt data coliected as part of The District's regular 
testing program were also abstracted for students at target grade, levels in 
sample schools. The social interaction of students of different ethnic 
backgrounds was observed in a variety of settings. And, in 1982-83,' a 
sample of 12th grade students completed a questionnaire on their post- 
secondary plans and preparation; 

Two sub-studies were also conducted during 1 981 -82. One sub-study 
examined the fidelity of programs implemented in new senior high magnets, 
using program documentation, observations, and interviews with 



administrators and teachers. The second syb-study investigated student and. 
parent understandings of the programs through interviews with sampled 

parents and students. ■ ' 

The formal data collection activities referenced above were augmented 
throughout the study by informal observations, interviews, .and review of 
District and program documents and, correspondence. The major findings and^ 
recommendations reported below emerged from the professional judgments of 
team members and a synthesis of this information over the two years. 

Moior Flivllngs 

The major findings of the two-yeaT study of Magnet programs can be 
organized around five areas: (I) mechanisms for obtaining student 
participation; (2) the extent of. desegregated enrollments in Magnet 
programs; (3) policies, procedures, and services contributing to integrated 
educational experiences for students; ik) fidelity of specialized ^ 
educational offerings as implemented,' to initial plans; and (5) progress 
toward reducing the court-identified harms of racial isolation. The first 
four areas relate to program' processes or implementation while the latter • 
concerns outcomes of the program. 

Program M«:h«nl«m. The. first set of findings concern the mechanisms c 
used to solicit>and maintain student participation in Magnet programs and 
the extent to which these mechanisms yielded desegregated enrollments in 
Magnet programs. Briefly, we found that: • . 

• While the 'District disseminates information about the program using 
'a variety of media (e.g., brochures, television, posters), written materials 

distributed at school for studenfs to share with their parents were the 
primary source of programmotic information for both students and parents. 

• During 1981-82, separate .brochures and applications were distributed 
for the Magnet and Permits With Transportation (PWT) programs, the two 
primary Voluntary Jntegratibn^ programs in the^ District . These materials, 
available in both- English and Spanish, were written at the 9th to 1 0th grade 
reading level. During 1982-83, a combined brochure and application was 
prepared, with one page of the brochure devoted to the PWT program and 15 
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pages to the. Magnet programs. These *mateYials, again available in both 
English and Spanish, were written at the Nth to 12th grade reading l^vel. 
District administrators felt that the combined format was confusing to 
parents. 

♦ » 

• .During 1982-83, distribution of 'programmatic information was* . - 
ttirgeted to all students in overcrowded schools. All other schools in^the 
District received IGO copies of the brochure in addition to a one page flyer 
distributed to all students. This procedure was. modified^for 1982-83 
recruitnrient so that all students in overcrowded and predominantly Hispanic, 
Black, Asian,' and Other non-Anglo (PHBAO) schools received the brochures. 
All other schools received 200 .copies of the brochure and. flyers for all 
students. 

• Efficient and timely processing of program applications and parent 
inquiries was hampered by cutbacks in District and regional personnel 
assigned to the Magnet programs and the relatively short timeline for 
application submission and processing. 

•x * , • Parents arid students reported choosing" a Magnet program because of 
their perceptions of the good educational quality of^the progj^am. Less than 
hplf of the parents interviewed were aware of other voluntary integration 
options available to them in the District. 

• Parents and students appeared to be generally satisfied with the 
program and' the vast n^ajority chose to re-enroll for the subsequent year. 

Student Enrellment. In examining the racial/ethnic backgrounds of 
students electing : to participate in Magnet programs, we found that: 

• ^ The overall student enrollment and the number of participants from 
each racial/ethnic group has increased over time. 

• Black and White students represented about one-third each of the 
populatiori of magnet st»jden?s, while Hispanic students accounted for about 
one-fifth of the enrollment. Given the representation of these groups in 
the District-atrlarge , Black and White students are over-represented in the 
•program while Hispanic students are under-represented. 

i WRen enrollments were examined program by program, slightly more~ 
than half of the elementary programs met the District-established 
desegregation criterion (40 • 60% PHBAO). About one-third of the junior 
high, senior high, and extended grade programs met this criterion. The 
majority of the secondary magnets were centers located on PHBAO carnpuses. 



PoliciM, Proetlc«$. and Servic«» Influencing kiteg^atlon,. In examin- 
ing actions taken in Magnet programs that encourage or inhibit integrated 
interactions among students of different ethnic backgrounds, we found that: 

• Administrators of elementary programs tended to report a strong 
influence of school policies on interaction among students. Administrators 
of secondary and extended programs saw student interaction as influenced to 
a greater extent by school personnel and by the students themselves. 

• Active efforts were taken in Magnet programs to encourage 
interaction among students of different racial/eihnic groups, through such 
techniques as student assignment to games andf^ictivities , active recruitment 
for organized activities, and inservice training./ These actions were 
evident during both years, although the incidence of inservice training for 
high school teachers was considerably lower during 1982-83 as compared to 

the previous year. 

• Magnet programs provided a wide variety of programmatic services 
for students, staff, and parents. Most of these services were viewed as 
moderate to very effective. However, teachers, and administrators in 
elementary and extended programs consistently noted less success in 
encouraging student participation in after-school activities in both years. 
Additional transportation arrangements for after-school activities were less 
frequent at these levels as compared to secondary programs. In contrast, 
while securing parental participation was noted as a problem area in 1981-82 
by teachers in junior high, senior high, and extended programs, they viewed 
activities as much more successful in this regard in. 1982-83. 

• A variety of college counseling services, such as individual 
counseling, meetings on college requirements, and financial aid, was 
provided for students and their parents. However, there was considerable 
variability in the number of students and parents participating in these 

activities across programs. 

_. . , ^jjt^T I ..,^00 funA oQiiinmpnt wos freouently noted 

• • he neea tor qquhiuuui icauui«-v-o ^...^ 

by teachers and administrators. 

• Tedchers and administrators also noted the need to improve the 
match, in some c oses, between the interests of students and programm atic 



offerings in the^election process. 
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Progrom Fidelity. A sub-study of new senior high Magnet programs 
conducted during 1981-82 indicated that: 

• The newly infiplenfiented senior high magnets showed a strong 
correspondence between their programs as planned and as implemented. Most 
deviations from plans occurred because resources were^.unava?lable to support 
specialized facilities or materials. Teachers and adrninistrators were 
generally enthusiastic about these new programs. (Similar findings emerged 
in a sub-study of the fidelity of programs at other levels conducted the 
previous year . ) ^ 

IProgrom Outcomet. The Team's examination of program outcomes centered 
around the progress made in reducing the four harms of racial isolation 
identified in the Crawford decision: achievement, attitudes toward school, 
post-secdndary opportunities, and social interaction among students of 
different ethnic backgrounds. We found that: 

• The average achievement of magnet students in grades 5, 6, and 8 in 
sampled Magnet programs was consistently above that of students in the 
District-at-large. Furthermore, when the average performance of students in 
different types of programs was examined, these averages surpassed the 
District-established mastery criteria on the SES for all program types at 

both grades 5 and 6. At grade 8, the average performance of students in 
different types of programs exceeded District averages with two exceptions. 
Thus, the consistently higher performance of students in Magnet prograrns is 
not accounted for solely by students in highly gifted and gifted programs 
but^^c^jff'^e^ seen in the other types of programs as well. 

^ • The attitudes of students toward school in elementary, junior high, 
and senior high Magnet programs were generally positive and^stable ever the 
two-year period. Their performance was consistently above the 50th 
percentile on published notional norms during both years. Students enrolled 
in extended or alternative school, programs tended to score consistently 
below their counterparts in the sdme grade levels on all sub-scales of the 
attitude measure. It is unclear whether the consistently lower attitudes 
of students in alternative prograrns were a reaction to t"he program itself or 
d function of the type of students, who we're drawn to this type of Magnet 
program'. 



• While limited information was available on post -secondary 
opportunities due to the recent establishment of most senior high^programs 
and the limited number of 1 2th grade students, the majority of seniors 
sampled reported that they expected to receive a high school diploma. 
Further i about 70% expected to pursue some type of post-secondary education.. 
However, due to missing data it was not possible to assess their preparation 

or eligibility for these pursuits. 

• Social interaction among students of various ethnic backgrounds was .. 
frequent and friendly in elementary programs. In junior high, senior high, 
and extended programs, intergroup interaction was somewhat less frequent; 
however, it tended to be positive when it occurred. The less extensive 
intergroup interaction in junior and senior high programs is due, at least 

in part, to the reduced opportunities for such interactions. Many of 

these programs operate as centers on PHBAO campuses so that, to some extent, 

opportunities for interaction are diminished. 

R<icamm0f$^l<ans 

Based on the findings of the two-year study summarized above, the Team 
formulated the following recommendations for the Magnet programs: 

1. Simplify the prose in the "Choices" brochure to lower the 
readability level to at least the 8th grade level. 

2 '.Reformat the "Choices" brochure to more clearly distinguish 
sections related to the PWT and Magnet programs. 

. 3. Develop separate applications for the PWT and Magnet programs with 
a simplified format. 

k Provide additional personnel and/or pre-recorded informational tape 
recordings to handle parent questions and inquiries durmg the 
application submission period. 

5. Distribute the "Choices" brochure to all students in the District. 

6. Move up the time period for distribution of brochures and 
submission of applications. Extend the amount of time for the 
processing of applications. 

7. Examine in g reater depth barriers to participation o f Hispanic 

' ^sTUdents in the Magnet programs and f^e actions to encourage -melT- 

participation. 
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8. Consider providing additional transportation to elementary and 
extended magnets to encourage participation of students in after- 
school activities . 

9. Provide inservice training for administrators, particularly at the 
secondary school level, on policies end techniques for N^romoting 
positive intergroup relations and fostering communication among- 
students of different racial/ethnic groups. 

10, Develop and implement a plan for identifying, prioritizing, and 
alleviating deficiencies in resources and equipment 'required to 
support the specialized educational offerings of Magnet programs. 

IK Investigate further the atMtudes of students enrolled in 

alternative programs and provide appropriate interventions to 
improve their attitudes; 

12, Monitor the post-secondary preparation and eligibility of high 
school Magnet students and toke actions as appropriate. 
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Permits With Transportation Program: , 
Evaiuotion Summary 



An assessment of the Voluntary Integration programs operation in the Los 
Angeles Unified School District (LAUSD) has been conducted for the past two 
years beginning with the 1981-82 school year. This report focuses on the 
Permits With Transportation program and presents results for the 1982-83 
academic year. An interim PWT report covering 1981-82 has been prepared and 
submitted to the District. Separate reports covering the Magnet and Yeor- 
Round Schools programs are also available. The primary purpose of the study 
was to provide, information to the District on the methods used in implementing 
the PWT program as well as on the progress achieved in alleviating the harms 
to participants associated with being educated in a racially isolated 
environment. The evaluation was carried out by an independent evaluation team 
of consultants working in conjunction with staff from the Research and 
Evaluation Branch of the LAUSD. 

This evaluation summary presents, in a more concise form, information 
•contained in the detailed evaluation report . A description of the environ- 
mental factors or context in which the evaluation was conducted, a summary of 
the evaluation methodolgy, and a presentation of the major findings and 
recommendations are al o included, the findings are based on the professional 
judgment. of the Team derived from an anafysis of the data presented in this 
repoit, on informatioh gathered over the past three years through informal 
interviews end discussions with District personnel , and on reviews of 
correspondence and documents as well as direct observations of program 
practices. The reader is encouraged to read the Prologue and this Evaluation 
Summary prior to reviewing the more extensive evaluation report. 

The Permits With Transportation program, commonly called PWT, actually 
began fifteen years ago when the District first provided transportation tc 
achieve voluntary integration. Under the name Voluntary Integration Program, 
500 students were bused voluntarily to receiving schoais. In the last decade, 
— ^he-PWT--pi^ram-gf^w^from-apf>f^-X)mG+ety-3T00(>-^^ydeots-^4 — : 



enrolled in the 137 receiving schools. 

The primary purpose of PWT is to provide opportunities for students to 
share.multicultural and educationol experiences in an integrated setting. A 
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secondary purpose is to relieve overcrowding in inner-city schools. Students 
are assigned to receiving schools according to District guidelines, and 
transportation is provided free of charge. 

"When the evaluation of Voluntary Integration progranfis began in 1981-82,^ 

^the District was in the process of phasing out a court-ordered mandatory 
busing progranfi and infipjementing a more extensive voluntary integration effort 
In the previous qcademic year (1980-81) under mandatory busing, many schools 
which formerly served as PWT receiving schools were paired or clustered with 
inner -city schools to achieve desegregation. As a result the voluntary PWT, 
program was reduced in scope. However, the phasing out of mandatory busing 
I98U82 saw a significant increase in PWT enrol Iment . ^ 
When the District entered the voluntary integration phase of the court- 
order, the evaluation effort was, in part , guided by the Court's directive to 
the District to provide 3 complete report of thi* "measures taken to alleviate 
the harms of racial isolation an J the results achieved". Thus, d focus of the 

'evaluation study was to provide information to the District that was 
responsive to the Court's concerns. That is, the Team examined program 
processes as well as outcomes. The outcomes included the four harms 
identified in the court case: student .achievement , student attitudes toward 
school, post-secondary opportunities, and student social interactions in a 
racially mixed environment. 

The size, geography, and changing demographics within the District 
created a context which enhanced the need for more voluntary busing^ Many 
schools within the District were severely overcrowded and projections 
indicated the areas served by these schools were increasing in population 
while areas in other parts of the District were losing students, partly due to 
demographic shifts and partly as a result of forced busing (White flight). , 
The District was and is continuing to experience significant increases in 

Hispanic and Asian enrollment while Black and White enrol Iment- is ideclining 

and some schools were severely underenrol led while others were bulging from ^ 
the seams. Thus, when mandatory busing was terminated, a partial solution to 

-4 bls-d4 1 e mma-w os-^t a~^^ner-ees^--yo^l u n to ry-b w si ng-; — { Anoth ery-^wos-fo— rmptem^l 
year-round scheduling in overcrowded schools, the subject of a separate 
report.) 
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In addition to demographic changes, other events were occurring in the 
Di'itrict which had implications for this evaluation. The District implemented 
multiple calendar schedules in overcrowded schools. Program adjustments 
related to changing from a mandatory to a voluntary desegregation plan were 
made. The District was faced with severe budgetary constraints brought on by 
the Proposition 13 tax initiative and there were critical teacher shortages in 
certain disciplines. District leadership changed with the appointment of a 
new superintendent which resulted in additional major organizational and 
personnel changes, and two new school board members were elected. 

The 1982-83 evaluation was refocused to provide information to District 
policy makers whose most immediate concerns were process oriented. Thus, 
while the reduction of harms remained an important consideration in the second 
year, the primary interest was on "progress" achieved over time. 

The original plan included a separate analysis of schools participating 
in Continued Integration programs (CIP). Under these Voluntary Integration 
programs, students attending schools which were paired or clustered under the 
mandatory busing program were allowed to continue to attend a school with 
which their resident school was paired or they participated in other special 
activities. However, in 1982-83 most of these schools also enrolled PWT 
students c^d the confounding was so great that a separate analysis was neither 
warranted nor d 3ctical. (See Chapter I for a more complete description of 
the Continued Integration programs.) 

Chapter II describes in more detail the methods employed in carrying out 
the study. Included in this summary is a brief overview of the evaluation 
issues, sampling, instrumentation, and data collection strategies. 

The process evaluation focused on two major categories: program 
mechanisms, and school policies and practices related to desegregation/ 
integration. As previously noted, the outcome issues correspond to the four 
harms identified in the Crawford court case. 

The PWT evaluation focused on receiving schools only, that is schools 
to which PWT students were bused. Because feeder patterns were potentially an 
important area of interest, a sampling strategy was adopted which allowed the 
Team to analyze the transition of PWT students as they progressed through the 
normal receiving school feeder patterns. This "linked" sampling began with a 
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stratified sampling of senior high schools, followed by a sannpling from the 
feeder junior high schools of the selected high schools, and a sampling from 
the feeder elementary schools to the selected junior high schools. Teachers 
and other school staffs were selected using a stratified random approach. 

A variety of data collection instruments were used based on a set of 
specifications which identified the evaluation issues, variables, measures 
and data sources. Data collection was managed by LAUSD Research and 
Evaluation Branch staff. 

AAajor Findings 

This section contains a summary of the major findings of this study. The 
findings are summarized under the categories contained in Chapter III: 
program mechanisms , school policies and practices , and outcomes . 

Program /Mechanisms 

1 . The "Choices" brochure was used to inform parents and students in the 
District about options available under the Voluntary Integration programs. 

This brochure contained information about the various Magnet School programs 
as well as the PWT program. 

2. While the "Choices" brochure represented a significant improvement in 
providing information to students and parents, the reading level was too high 
and the orgonization of material was somewhat complex for the intended 
audience. 

3. PWT enrollment increased by nearly 50% from 13,812 students in 
1981-82 to 20,686 in 1982-83. Three-quarters of the increase occurred in 
1981-82 and was attributed to the existence of fewer PWT receiving schools 
under the mandatory busing program in 1980-81. Between 1981-82 ond 1982-83 
the program increased by slightly less than 10%, 

4. As overall program growth continued at the e'ementary and junior high 
school levels and leveled off at the senior high school level, Hispanic and 
Asian students represented a larger proportion of the total program enrollment 
while the percentage of Black students continued to decline. 

• While every ethnic group increased in enrollment, the largest 
two-year gains were registered by Hispanic (169%), Native American 
(127%), and Asian (86%) students, respectively. 

• Black students still retained the largest enrollment in the program 
(77% to 64%), with virtually no increase between 1981-82 and 

1982-83. 
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• The proportion of Hispanic students in the program increased 
from only of total enrollment in 1980-81 to 26% in 1982-83. 
While most of this increase occurred between 1980-81 and 1981-82, 
enrollment grew by one-third !n 1982-83 as well, representing 
nearly three-fourths of the total second year change in PWT 
enrollment . 

• Hispanic (72%) and Asian (22%) students accounted for all the 
program enrollment increase in 1982-83. 

5. The PWT program results in over 20,000 predominantly Hispanic, Black, 
Asian, and Other non-White (PHBAO) students attending desegregated elementary, 
junior high, and senior high schools in LAUSD. 



School Policies and Practices 

6. School policies and practices related to student social interactions 
vary by school level. That is, elementary schools exert more control over 
student social interactions than do junior high schools. At the high school 
level these interactions are determined by the individual student. 

7. Most school administrators acknowledged the need to be proactive 
regarding the social interaction of students from different racial/ethnic 
groups. They actively recruited PWT and resident students to participate in 
organized school activities and felt their actions could have some influence 
on student interactions. 

8. The academic needs of PWT students were a high priority for 
elementary and secondary school administrators while social adjustment needs 
were more of a concern of secondary school administrators. 

9. Elementary and secondary school administrators conducted inseivice 
training for school personnel on the needs of PWT students and parents; yet 
relatively few teachers (between !3% and 27%) reported participating in in- 
service training covering these topics. 

10. Efforts are being made by some elementary and secondary teachers to 
address the academic and social needs of PWT students in the classroom, 
although the overall magnitude appears to diminish as students get older. 
Elementary teachers who have students for the entire day were more likely to 
addiess these concerns. 
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11. Elementary and secondary school administrators have not found a 
successful strategy for increasing PWT parental involvement in school related 
activities. Senior high school counselors, in particular, perceived PWT 
parent participation in counseling related activities as significantly lower 
than parents of resident students. 

12. In response to a recommendation contained in the 1981-32 interim 
evaluation report, over 85% of secondary schools and 44% of elementary schools 
provided an orientation program for PWT students and parents covering a 
variety of topics including: introduction to school personnel; tour of school 
facilities; academic counseling and advising service (secondary only); 
extrccurriculdr activities for parents; transportation arrangements; and 
program expectations of students and parents. 

Outcomes 

13. Elementary teachers and administrators perceived PWT students as 
having the same success socially and slightly less succ^iss academically than 
resident students. At the junior high level, PWT stuJents were perceived to 
be less successful both academically and socially tha'i resident students: 
while senior high school administrators and teachers rated PWT students as 
less successful academically but equally successful socially in comparison 
with resident students. 

14. Grades 5 and 6 PWT students* performance improved on the Survey of 
Essential Skills (SES) although their scores fell below District averages in 
reading, mathematics, and composition in 1981-82 and 1982-83. 

15. In comparison to resident students scores in PWT receiving schools. 
District averages, and national norms, grade 8 PWT students have not made 
comparable progress in the areas of reading and mathematics achievement as 
measured by their scores on the Comprehensive Tests of Basic Skills (CTBS). 

16. The peformance of grade 12 PWT students on the District proficiency 
tests (TOPICS, SHARP, and WRITE:SR) improved in 1983 over 1982. The 
percentage of PWT students passing ail three proficiency tests exceeded the 
District averages the last two years (1982 and 1983). 

17. The attitudes toward school of PWT elementary students improved 
slightly and continued to be at about the national median. On the other hand, 
grade 8 PWT students tended to fall slightly below the national norms on the 
School Attitude Measure (SAM). However, their scores were consistently 
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higher than the PWT receiving school mean scores. Grade 12 PWT students 
showed consistent improvement in their attitude scores over 1 981 -82, They 
continued to score above the national median and above the PWT receiving 
school means. 

18. in comparison to resident students, PWT students were less 
prepared for college. On the overage they completed fewer college preparatory 
courses and had significantly lower grades and SAT verbal or.d moth scores. As 
a result, the proportion of resident students estimated to be eligible to 
attend the University of California (UC) and the California State Universities 
and Colleges (CSUC) was double the proportion of PWT students estimated to b 
eligible to attend these institutions. 

19. The post-secondary plans of PWT and resident students were 
consistent with their academic achievement, and there were no significant 
differences in the plans of PWT and resident students with similar academic 
preparation. 

r toco n nwH lirtiqm 

^ I. A single brochure similar to "Choices" should continue to be used to 
inform parents and students about options available under the Voluntary 
Integration programs in the District. However, the reading level of these 
materials should be lowered to at least the seventh or eighth grade level and 
the organization and presentation of material should be simplified. In 
addition, a better balance should be achieved between the space allotted to 
PWT and the Magnet programs. Finally, separate applicatior^^s should be 
included (perhaps back-to-back) for PWT and Magnet ^programs. 

2* District staff should insure that inservice training is provided for 
all PWT receiving school personnel. Topics should include: 

• Changing size and character of the PWT program: implications for 
instructional programs, academic support services, and training 
needs of school personnel. 

• Goals and expectations for school personnel in meeting the needs of 
all studeniis, including PWT students. 

• Importance of parent involvement in a successful program and 
strategies for attaining parent participation. 

• Effective strategies for meeting the individual academic and social 
needs of students from diverse backgrounds and for promoting 
intergroup understanding and acceptance. 

• Significant findings and recommendations of the PWT evaluation. 



3. Special efforts should be made to involve PWT receiving school 
teachers in the planning and implementation of the Inservice program. 

4. A special study of the factors influencing the lack of involvement 
of parents of PWT students in school activities should be undertaken. 

5. An orientation for all new students and their parents should be 
conducted at every PWT receiving school and every effort made to n^aximize the 
attendance of PWT students and their parents. Topics should include: 

• Introduction to school personnel 

• Academic program opportunities and qualifications to participate 

• Special academic support services (counseling, advising, tutoring, 
etc.) 

• Need and ppportunities for parent involvement 

• Academic and social expectations of students 

• Extracurricular activities 

• Transportation arrangements 

6. Information presented in the orientation session should be provided 
in writing to every student and parent, but especially to those who were 
unable to attend the orientation. 

7. A special study should be conducted of the factors affecting the 
academic achievement of PWT students. The study should include an assessment 
of course selection patterns, articulation between sending and receiving 
schools, curriculum, PWT students' "quality of effort" toward school work, 
academic expectations of PWT students and parents, and characteristics of 
"successful" PWT students. 



-21- 



102 



Ymsr-Round Schools Progromt Evoluotim Summorr 



The 1982-83 evaluation of Yeor-Round Schools has been completed. In this 
study, ^0 of the 95 schools in the YRS program participated. The Yepr-Round 
Schools program was established as one of the District's responses to 
overcrowded schools. The goal of the YRS program is to alleviate overcrowded 
conditions without adversely affecting students* educational opportunities or 
parental and community attitudes towards the program^ Evaluation questions 
were framed to address the general goal of the study. 

Data were collected from District archives, school principals, other 
administrators and teachers at the schools, and students. Parents at a sub- 
sample of schools, were also asked about their opinions of YRS, In addition, a 
small number of schools were studied in order to determine the nature of their 
instructional practices. 

The findings for this year's study are generally encouraging, YRS 
dramatically operates to reduce overcrowded conditions. School personnel 
reported, on the whole, that YRS operations, features, and effects have 
improved this year. Areas of concern remain related to extracurricular 
activities for students (also noted by parents as a problem) and for issues 
dealing directly with teaching conditions, for example, warm weather and 
shared classrooms. Student performance on the regularly administered 
District-wide tests has shown improvement this year compared to earlier 
studies. Corroborating the standardized test scores are reports of 
significontly higher scores on the Scholastic Aptitude Test (SAT), both verbal 
and mathematics sections, increased percentage of !2th grade students passing 
the District-wide proficiency tests, and significantly higher grade point 
averages for 12th grade students. Student attitudes, as measured by a 
standardized instrument, are similiar to those of last year, with the majority 
of student scores exceeding national averages. Students' unexcused absences, 
suspensions, and incidents of vandalism ore generally down, althc^jgh senior 
high school suspensions are up. Most parents reported general satisfaction 
with YRS, based on our sub-study; however, areas of concern that 




are the same as last yeor are job opportunities for students, and 
extracurricular activity choices for students. Our instructional sub-study 
shows that teaching practices consistent with effective schools are in use by 
YRS staff. 

Summary of the Instructional Sub-Study 

The sub-study yieided a description of the character of instruction in a 
small sample of YRS. These descriptions were drawn from interviews 
with teachers and principals, observations of reading and math instruction, 
inventories of curriculum materials, and District records. Formal data 
collection was supplemented by informal interviews and observations by site 
visitors. A number of results were found. 

There were no systematic differences in the average levels of achievement 
of students In sampled YRS compared to students In similar schools (matched on 
demographic characteristics) operating on a traditional schedule. 

Thei-e was marked improvement in the performance of 5th grade students on 
the SES in sub-study schools categorized as lower achieving in 1981-1982. 

Teachers and principals tended to have positive views of their school's 
academic focus and learning environment. 

All of the principals and the majority of teachers favored the YRS 
schedule to the traditional September-June schedule from an educational point- 
of-view . 

Principals and teachers generally agreed that teacher stress, teacher 
stamina, and student retention were improved under the YRS schedule. 

Summary of the Parent/Student Sub-Study 

A survey to assess the attitudes of parents of participating students was 
conducted. A questionnaire was developed to provide information concerning 
preference for YRS or traditional scheduling in reference to child care, 
vacation schedule, homework, attendance, academic performance, and a number of 
other variables. Twenty-four schools, four classes per school were involved 
in the survey. The questionnaire was administered to sixth, eighth, and 
twelfth grade students and the same students took another questionnaire home, 
with clear instructions on how to assist their parents in completing it, if 
necessary. 
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In general, both parents and students reported that students' feelings 
about school were substantially better this year, and responses reflected 
general satisfaction with the quality of education, behavior, homework, and 
attendance . 

Neither parents nor students expressed strong reservations regarding 
employment opportunities during off -track time. Forty-seven percent of the 
high school students felt their chances of finding a job were somev/hat betfer 
or better this year than last year and 80% felt they were the seme or better. 

Along with parent participation at school, both parents and students gave 
the lowest percentage of positive responses to school conditions during hot 
weather in summer. Also, parents continued to have difficulty in arranging 
for child care and in planning vacations with the year-round schedule, but 
overall about one-third reported the situation to be better this year. 

R>c oHwi«m tatlqnt 

The Los Angeles Unified School District (LAUSD) reported on its efforts 
to deal with continuing problems related to mointenonce of schools, the summer 
heat problem, and building options as a way to deal with overcrowding. The 
District is also attempting to improve its administrative liaisons with YRS 
and communication with parents. It appears that the LAUSD efforts with the 
YRS program ore beginning to result in positive trends in many significant 
areas. Because some problems remain, the following recommendations ore mode. 

1. The District should anticipate the levels of enrollment likely to 
affect a given school so that more notice to schools and parents con be given 
concerning changes in schedule or configuration. 

2. The District should, because of the continuing conflict in schedule 
among different schools, consider moving all YRS to the some schedule. This 
will reduce ambiguity for parents and school personnel, regularize contact 
among schools, and obvSate the need for repeated schedule changes. 

3. The District should continue its practice of providing support to YRS 
for custodial and general maintenance. Equipment repair opportunities should 
also be scheduled with YRS needs in mind. 
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A. The District should continue its efforts to match its administrative 
services to the year-round calendar. 

5. The District should encourage local communities to provide recreat- 
ional and other ancillary services to assist out-of-session studf)nts. 

6. The District should continue Its building and air conditioning 
programs so that the envirottment in YRS is as comfortable and educationally 
sound as possible, 

7. The District should continue its efforts, both centrally and at the 
school sites, to inform parents about YRS and to provide options for those 
parents who prefer some alternative for their children. 

8. The District should consider additional research in the area of 
student achievement; how it is developed or affected by the YRS program. 
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I . INTRODUCTION 



Design Overview 

The 1982-83 evaluation for those schools that are predominantly (70%) 
Hispanic, Black, Asian and other non-Anglo (PHBAO) will consist of three 
analytic approaches: a harms analysis, an implemented tion analysis, and 
an effectiveness analysis. These three analyses are summarized briefly 
below. 

1 • Harms Analysis . This analysis will examine the progress made by 
the Los Angeles Unified School District in reducing the four "harms of 
racial isolation." Specifically these include low achievement, low 
self-esteem, interracial intolerance and hostility, and limited access 
to post secondary opportunities. In order to ascertain such progress, 
the following procedures will be implemented: 

1 . High and low scoring schools will be selected for each of the 
four harms, (e.g., schools that score higher on self-esteem and 
schools that score lower on self-esteem) . Determinations of 
scoring status will be based on existing and newly collected 
data . 

2. A sample of PHBAO schools which share a common constellation 
of programs will be selected. 

3. As appropriate, staff, parent, and student data will be collected 
to determine which particular practice(s) relates to higL- and 
low-outcomes on the "harm" variables. 

Conceptually, this approach represents a significant departure from 
prior PHBAO evaluations. The schools, rather than the individual pro- 
grams, will be the unit of analysis. Hence, there will be no attempt to 
relate individual PHBAO programs to progress with regard to specific 
harms. Similarly, there will be no efforts to make casual statements 
concerning specific programs and outcomes. 



2. Implementation Analysis . A second focus of the 1982-83 evaluation 
involves collecting implementation data about the seven programs as 
requested by the District's Office of Student Integration Options and the 
Office of Compliance — Integration. These seven programs are Computer 
Assistance, Curriculum Alignment, Project Textbooks, Student- to-Student 
Interaction, Supplemental Counseling, Urban Classroom Teacher Program, 
and Bilingual Classroom Teacher Program. The emphasis of this aspect of 
the evaluation will be to (1) determine whether the seven programs are in 
place, and (2) identify the implementation strategies which are associated 
with staff/parent perceptions of outcomes. 
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3. Effectiveness Analysis > A third focus will be a survey of 
perceived effectiveness of all programs. Year-Round schools and non-Year-Round 
schools will be compared for each of the 19 urograms. The programs are: 
(1) Computer Assistance, (2) Curriculum Alignment, (3) Project Textbook, 
(4) Student-to-student Interaction, (5) Supplemental Counseling, (6) 
Bilingual Classroom Teacher Program, (7) Urban Classroom Teacher Program, 
(8) Administrative Development program, (9) Selection of Department 
Chairperson, (10) Leadership Team Program, (11) Staff Development, (12) Language 
Acquisition, (13) Class Size Reduction, (14) Instructional Adviser Program, 
(15) Maintenance/Alteration/lmprovement Program, (16) Project AHEAD, (17) Extension 
of the Primary School Day, (18) Articulation, and (19) Parent-Teacher Conference 
Program. 

Additionally, a comparison of Year-Round schools and non-Year-Round schools will 
be made for 1983 achievement and self-esteem data. 

Goals 

In keeping with the analytic approaches presented above, the 1982-83 PHBAO 
evaluation objectives are as follows: 

1 . To identify those general educational practices and procedures 
that are related to each of the four "harms of racial isolation," 
(i.e., low achievement, low self-esteem, interracial intolerance 
and hostility, and limited access to post secondary opportunities). 

2. To identify particular educational practices and strategies that 
are related to high- and low-outcomes on the "harm" variables. 

3. To collect and document pertinent implementation and outcome d^ta 
for each of the following seven programs: 

a. Computer Assistance 

b. Curriculum Alignment 

c. Project Textbooks 

d. Student-to-student Interaction 

e. Supplemental Counseling 

f . Urban Classroom Teacher Program 

g. Bilingual Classroom Teacher program 

4. To ascertain the overall effectiveness of all programs. 

5. To compare Year-Round and non-Year-Round schools in terms of per- 
ceived program effectiveness, student achievement, and student 
self-esteem . 
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Sample Descriptions 



1 . Basic Sample . As previously mentioned, the schools will be the 
unit of analysis. Comprising the basic sample will be 124 of the 298 
PHBAO schools. Included in this number are 64 elementary schools, 37 
junior high, and 23 senior high schools. These schools represent 27% 

of the PHBAO elementary schools, and 100% of the PHBAO junior and senior 
high schools. 

2. Test Sample , From the basic sample will be selected 77 schools 

to comprise the sample used for the student achievement ( Survey of Essentia l 
SJ^ills and Comprehensive Test of Basic Skills ) and student attitude ( School 
Attitude Measure ) data. All of these schools, 64 elementary, 8 junior 
high, and 5 senior high, were included in the 1981-82 sample* 

3. Interview Sample . in a preceding section it was mentioned that 
interviews will be conducted at a sample of PHBAO schools which share 
certain programs. This interview sample will be selected from the basic 
sample described above. A criterion for selection to the interview sample 
will be that the particular school be a high or low scoring school on a 
particular "harm of racial isolation." Thus, for the harm "low achieve- 
ment," an interview sample will be drawn from high achieving and low achieving 
schools. Interview data will be collected from each of these intervievy 
samples regarding each of the four "harms." 

4. Specified Sample . Evaluations of the Computer Assistance, Curriculum 
Alignment, Project Textbook, Student-to-Student Interaction, Supplemental 
Counseling, Bilingual Classroom Teacher Program, and Urban Classroom Teacher 
Program will be conducted on a specific sample of the basic sample in which 
these programs are implemented. The evaluation of these programs will be 
conducted by collecting observation, interview, and survey data. For example, 
observational data will be collected in the Student-to-Student Interaction 
Program . 

Instrumentation 



1 . Survey data . Questionnaires will be the instruments used to collect 
survey data. These data will be collected at three different times. The identi- 
fication of the high and low scorers of the two harms: the Reduction of Inter- 
racial Intolerance and Hostility and the Increased Access to Educational 
Resources and Post-secondary Education Opportunities will be made through 
the use of the first questionnaire, puestionnaires will also be used as a 
means to evaluate the various program?^ listed under the specified sample 
section. Thirdly, questionnaires will also be used to survey the perceived 
effectiveness of all programs . 
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The determination of the high and low scoring schools regarding interracial 
hostility will be made by means of a questionnaire. integr<ition Coordinators 
will be contacted for information regarding the degree of interracial hosti- 
lity in their schools. The total of high and low scores will be used to 

draw the high and low schools in interracial hostility. 

* > 

2. Interview Data . Interview data will be collected in order to gather 
information regarding the "harms" as they relate to specific educational 
practices and procedures. A theoretical sample of school participants will 
be drawn from each of the schools selected. Comprising this sample will 

be students, teachers, administrators, and counselors. The participants 
will be chosen based on the relevance of their participation with regard 
to the four "harms." Open-ended, unstructured questionnaires and topic 
guides will be used to gather these data. 

3. observation Data. Observation data will be collected, as appro- 
priate, to gather information regarding the "harms" as they relate^to speci- 
fic educational practices and procedures. A theoretical sample of school 
activities and/or processes will be drawn from each of the schools selected 
as is relevant. Observational check-lists and other appropriate mean^^ 
will be used to gather these data. 

Observation data will also be collected, as appropriate, to gather 
information regarding the implementation of the seven programs receiving 
an in-depth assessment. A theoretical sample of activities and/or processes 
wj.. 1 be drawn from the sampled schools to be observed. Observational 
check-lists and other appropriate means will be used to gather these 
data. 

Data Collection 

Data collection will consist of several stages. First, the determination 
of high and low scoring schools on each of the four harms must be made. 
Data collection is necessary for the 'Reduction of interracial Intolerance 
and Hostility* and 'Increased Access to Educational Resources and Post 
Secondary Education Opportunities' harms in order to determine the high 
and low scoring schools. Data related to the two harms 'Improved Academic 
Achievement' and 'Increased Self-Esteem' are already available from last 
year's testing. The determination of the high and low scoring schools 
with regard to these two harms can be readily determined. 

Second, interview data will be collected from a sample of participants 
in the sample schools. Third, evaluation data of the specific programs 
will be collected by questionnaires and interviews. 
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All data collection activities will be coordinated so that a given site 

will have all data collection activities taking place during the same period. 

II. RESEARCH APPROACH 



Described briefly below are the approaches to be taken in collecting harms 
data, implementation data, and effectiveness data. In Section ill we 
describe our approach for the analysis of 1983 achievement and attitude 
data* 



Progress Towards Reducing the Harms of Racial Isolation 

Limited Access to Pc ot-Secondary Education* in January 1983, we will 
select a small sample (maximum N=:6) of senior high schools in which students 
have high and low access to post-secondary education* Sample selection 
will be based on the percentage of June 1982 graduates who requested their 
transcripts to be sent to colleges and vocational schools* To estimate 
the error involved in this type of procedure, we will obtain information 
about actual student attendance from a small, randomly selected group of 
parents at each sample school* When possible, we will control for student 
achievement in the selection of sample schools, and will include a limited 
number of non-pHBAO schools for comparative purposes* 

At each school, in-depth interviews will be conducted with teachers, 
principals, and counselors in an attempt to identify practices which relate to 
high and low levels of post-secondary educational outcomes. Practices to be 
examined include: 

tracking of students in vocational/academic classes 
collection and dissemination of information about colleges and 
scholarships 
~ development of student leadership 

- exposure of students to a variety of career options 

- quality/frequency of counselor interactions with students and 
parents 

school involvement with potential employers of students 

0 
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2. LOW Achievement . An attempt will be made to d-termine which factors 
and school practices differentiate between schools with high achievement 
and those with low achievement scores. Factors and practices considered 
may include, but are not limited to, teacher preparation, experience and 
i^ectations of students, time spent by studen. -n learning tasks, school 
staff morale, larent- teacher communication, availability and utilization 
of textbooks, and the extent and nature of teacher supports (e.g., staff 
development, language instruction, salary differentials, school manage- 
ment training, etc.). Such considerations will be expanded and/or refined 
to include key process and outcome factors associated with the core cluster 
of PHBAO programs , 

A small sample will be used, thus allowing labor intensive data collection 
procedures (i.e., observation and interviews). The sample will be stratified 
according to the level of achievement scores . 

3. Low Self -Esteem . On-site interviews and naturalistic observations 
will be carried out at a selected sample of PHBAO schools. Included in 
this sxmple will be elementary, junior high, and senior high schools that 
are high self-esteem scoring schools ana low self-esteem scoring schools, 
as assessed by the School Attitude Mea;,ure (SAM) data obtained in April, 
1982. 

The purpose of the Interviews and observations will be to make explicit 
the educational practices and prevalent belief systems that appear to be 
operative in high scoring self-esteem schools and those that exist in low 
scoring self-esteem schools. Data will be collected from students, 
teachers, administrators, counselors and parents associated, with each of 
the sample schools. An attempt will also be made to characterize the 
practices and belief-systems related to high and low self-esteem according 
to school level, i.e., elementary, junior high, and senior high. 

Described below are those areas that will in all likelihood be examined 
in an effort to articulate the practices and prevalent belief systems that 
exist or do not exist in high-scoring and low-scoring self-esteem schools. 

the general self-concepts of the students 

- perceptions the school staff has regarding the students' academic 
abilities 

the students' attitudes toward school in general 
the students' self-concepts as learners 

- the availability of high self-esteem models for students 

- the existence of, school-related mechanisms where students receive 
recognition ?.s intrinsically valuable and important individuals 

- the presence of structured school activities where students are 
encouraged and motivated to be independent, to exercise their own 
potential, and to think for themselves 

- the implementation of classroom activities where students' physical, 
mental and emotional capabilities are identified and nurtured 

- the carrying out of academic practices that convey to students 
that education is meaningful and serves a real purpose in life 
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4. Interracial Intolerance and Hostility , Consistent with the overall 
I program evaluation, the unit of analysis of the "harm," reduction in 
interracial hostility, will be schools. The hj.sjn and low scoring schools 
will be determined by administering a short questionnaire to Integra- 
tion Coordinators. For example, they will be asked to identify anC rank 
those schools that exhibit high and low degrees of interracial intolerance 
and hostility. Those rankings will subsequently be converted to in.iividual 
scores which will be .sammed to provide high and low scores for each school. 
Those PHBAO schools with the highest and lowest scores will be drawn for the 
sample. The sample will include elementary, junior and senior high schools 

After the high and low scores on the harm of interracial hostility 
have been determined, a sample will be selected for interviewing. 

Open-ended and structured questionnaires and topic guides will be used to 
gather data regarding interracial hostility. The integration coordinators, 
school administrators, such as principals and vice-principals, teachers and 
other staff members, such as counselors, students, and parents will be interviewed. 
Possible questions might include the following: 

- What is the racial composition of the school? 

- How do you know there is interracial hostility among your students? 

- What activities seem to draw all kinds of students? 

- What activities seem to draw particular types of students? 

- Why do you think students fight each other? 

- What do you do to try to teach students to cooperate with each 
other? (What do you do to try to cooperate with students of 
other ethnic groups? ) 



Program Implementation Analys is 
1 . Computer Assistance 

Description: The Computer Assistance Program supports the 

utilization of hardware (computer equipment) 
and' software (computer system) in 20 schools. 
The two available systems consist of (i) Student 
Data System, which includes student identification 
and class assignment information; attendance 
records and report generating capacity are being 
developed; and, (2) Cc^.puter Managed Instruction 
Reading, LAUSD. 
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Methods: The program utilizes data processing systems to 

reduce record-keeping related to programming, 
placement, and grading students and facilitates 
instruction specific to identified student needs. 



Target Schools: 20 schools in high transiency areas. 
Evaluation 

Topics: General 

1. How often are the two systems used in the 
schools? 



2. How do administrators, school coordinators 
and teachers describe the benefits of each 
program? 

3. To what extent is the capacity of each program 
used? (e.g., ID 99) 

4. Has district support been useful and sufficient? 
(in-service, on-site visits, materiel) 

5. Is record-keeping time reduced for teachers? 
If so, how is the freed time used? 

CMI Reading 



1. What percentage of computer operator time is 
devoted to running this program? 

2. How useful are the reports in instructional 
planning and parent conferencing? Which 

of the reports are most useful for these 
purposes? 

3* Which reports generated by this sub-system 
have teachers requested most often? 

4. Are there differences i i the students* growth 
in reading skills in those schools that use 
the program extensively and those schools that 
use it less extensively? 
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!• What percentage of computer operator time is 
devoted to running this program? 

2d Who are the recipients of the reports that are 
generated? 

3 • Which of the programs are described as 
most useful? 

2 • Curriculum Alignment 

Description: The Curriculum Alignment Project is based on 

the concept that: "Student instructional 
accomplishments will be more reliably attained 
and recognized when the three elements of a 
curriculum - objectives, instruction and 
assessment - are aligned." Instruction is focused 
on essential grade-level skills. Alignment is 
accomplished through instructional planning 
: that involves five steps: review of grade-level 

objectives established by the District, setting 
priorities , planning instruction, checking 
progress, and acknowledging acccomplishments • 



Methods : 



Using a trainer-of- trainers approach. District, 
region, and school level personnel, along with 
SWRL (program developers) consultants assist 
teachers in (1) matchir.ig their classroom instruction 
with the District-defined essential skills for 
reading, mathematics, and written language and 
(2) matching the time required for what they need 
and want to teach with the time actually available 
for instruction. 



Target: 



All PHBAO schools 



Evaluation 
Topics : 



With what frequency have specified subject 
areas been selected by schools for curriculum 
alignment implementation? 



How do trainers evaluate their role and 
function in the program? 

How do teachers assess the utility of program 
related ia-service« 

To what extent do teachers engage in project 
activities? How helpful are these activities? 



EKLC 



what recommendations do trainers, principals 
yahd teachers have for improvement? 
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3 • Project Textbook 



The program is designed to improve the quality 
of instruction at program schools by ensuring 
that all students have individual textbooks for 
basic subject areas o ' 

To ensure that all students have basic textbooks. 

To promote a sense of student responsibility for 
the books • 

To determine basic textbook overages and short- 
ages • 

To coordinate District inventory with school 
inventory • 

To provide s*:aff development which focuses on 
the use of books. 

To involve parents in promoting students* book 
maintenance responsibilities. 

To encourage students to take responsibility 
for books through activities such as using 
rubber stamps ("Responsibility Is Mine") 
and making bookmarks and backpacks. 

Target Schools: Two hundred ninety-eight PHBAO schools participate 

in the program. Two hundred thirty-eight are 
elementary schools, 37 junior high schools 
and 23 are senior high schools. 
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Description : 



Objectives : 



Methods : 



study Sample: Data Collection: The sample will include 12 schools 

with four schools at each school level. At each school 
interviews will be conducted with the principal and 
four randomly selected teachers. 

Evaluation 

Topics: Interviews will ascertain 

- whether the program is "in place" 
whether ordering and distributing 
procedures are followed 

the usefulness of the program 
teachers* familiarity with the program 

- problems with program implementation 

- ways of improving the program 



Student-to-student Interaction 



Description: 



Objectives : 



Methods : 



This program is designed to increase positive 
student interaction among students of different 
ethnic groups. 

To reduce racial isolation. 

To promote inter-cultural/racial understanding. 

To promote positive student interaction. 

Pairing areas and schools within areas to engage 
in the following activities: 



. camping 

Sea Education Afloat (S.E.A.) 
• Pre/Post activities for camp and S.E.A. 

Involving the Student Integration Options Advisory 
Council Committee in promoting student interaction, 
providing input on program, personnel selection, and 
curriculum. 



Target Schools: 



These schools consist of paired schools including 
PHBAO and non-PHBAO schools. The total number of 
PHBAO schools is 238 elementary, 37 junior high 
and 23 senior high schools. 
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Evaluation 
Topics : 



1. How many students, in what ethnic group, parti- 
cipate in each activity? 

a. What factors seem to contribute to differ- 
enciated participation? 

2. Did student knowledge/awareness of other ethnic 
groups increase? 

a. What kinds of knowledge/awareness do these 
students have? 

3. Did student interaction with students from 
other ethnic groups increase? 

a. What activities seem to be most conducive 
to inter-ethnic interaction? 

b. What activities seem less conducive to 
inter-ethnic interaction? 

4. Did student acceptance of students from other 
ethnic groups increase? 

a. Do students work, eat, play, and converse 
with students of other ethnic groups more 
now than they did two years ago? 



Supplemental Counseling 
Description : 

Objectives: 
Methods : 



Target 
Schools : 



The Supplemental Counseling Program is intended 
to provide students with additional counseling 
assistance • 

To develop a whole-child approach to counseling 
so that students will receive maximum benefits 
from their three-year senior high school 
educational experience • 

The Supplemental Counseling program has as its 
goal a student-counselor ratio of 375: 1« In 
addition, whenever possible, counselors are to 
maintain the same students for the duration of 
their senior high school experience* 

Twenty- three PHBAO high schools are involved with 
the Supplemental Counseling Program. 
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Three groups will respond to the evaluation 
questions. They will be Supplemental Program 
counselors, regular counselors assigned to PHBAO 
high scnools involved with the Supplemental 
Counseling Program, and students attending these 
designated high schools. Each <jroup, where 
appropriate, will provide feedback to the following 
questions: 

Do the counselors, both regular and Supplemental 
Program counselors, meet individually 
with students on a regular basis? 
- Are the counselors able to engage in group 
counseling activities when needed? 
Are the counselors able to assist students 
with such problems as low self-esteem and 
isolation? 

Is the student-counselor ratio of 375:1 
satisfactory? 

Are the counselors adequately trained to 
perform their duties? 

What proportion of the counselors' time is 
consumed by counseling and non-counseling 
duties? 

Do the counselors provide students with help 
related to course requirements, graduation 
requirements, college entrance requirements, 
and career opportunities and career requirements? 
Do the counselors assist students in defining 
their three-year educational plan? 
Has the creation of the Supplemental Counseling 
Program resulted in changes in the structure and 
organization of the counseling programs? 

6 • Urban Classroom Teacher Program 

Description: The basic goal of the Urban Classroom Teacher 

Program is to improve the staffing at 120 
program schools. 

Objectives: To recruit and retain teaching staff. 

To upgrade teaching quality. 

To provide additional services to students. 

-13- 



Evaluation 
Topics : 
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Methods: To provide staff with salary differential. 

For teachers to assume addi tonal curricular and 
extra-curricular responsibilities for 2-1/2 hours 
weekly. 

The sample will consist of 15 schools with five schools 
at the elementary, junior and senior high levels. 
An ethnographic case study approach will be utilized. 
At each school, interviews will be conducted with 
the principal and a random sample of four teachers. 
A limited number of parents and/or students will also 
be interviewed. Obsv-rvations of before/after school 
activities will also be made. 

Evaluation The evaluation will address the following 

Topics: issues: 



Study Sample/ 
Data Collection: 



1. Procedures for involving Teachers in UCTP 

. Needs assessment process 

. Use of commitment forms 

. Relationship between commitment and needs 

. Effect of Lump Sum Differential on morale 

2. Stability of Staff 

Pactora related to effective recruitment of 

teaciiier 3 

^ - . Factors related to teacher absenteeism 
, Factors related to teacher turnover and 
stability 

3. Additional Te^,cher Responsibilities 

, Scheduling of extra 2-1/2 hours weekly 

. Actual use of the time 

, Quality of the extra time 

, Student benefits from the activities 
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7 . Bilingual Classroom Teacher Program (BCTP) 



Description: 



Objectives : 



Methods: 



Target Schools: 

Evaluation 
Topics : 



The Bilingual Classroom Teacher Program (BCTP) was 
developed in order to meet the the needs of national 
origin minority students by providing (1) salary 
incentives to recruit and retain bilingual teachers 
at specific locations, and (2) improve the language 
services for Limited-English-Proficient (LEP) students. 

To have qualified bilingual teachers a^ree to 

assume additional assigned duties and responsibilities 

for two and one-half hours each week. The assumption 

is that these additional responsibilities will lead 

to improvements in curriculum, instruction, and services 

to NES and LES students • 

In order to achieve this goal, the BCTP awards teachers 
possessing an appropriate bilingual credential a salary 
differential amounting to $2,000 per school year* In 
addition, those teachers who have been identified by 
the District as having A-level fluency in a language 
of need receive a differential of $1,000 per school 
year. 

It is the responsibility of the principals who are at 
schools having a BCTP to assess the needs of their 
school, and then to develop goals and objectives for 
the particular BCTP. Each BCTP commitment must (1) 
be conducted on a regular basis; (2) have commitments 
approved by the principal and must assist in improving 
curriculum, instruction, and services to students; 
and (3) have a specific number of pupils involved. 

All 298 PHBAO schools are eligible for BCTP. 

The evaluation of the BCTP will consist of three foci. 
The first will assess what impact the BCTP has made 
with regard to the language services provided for LEP 
students. The second focus of the evaluatin will deal 
with the issue of the recruitment and retention of 
bilingual teachers^ The third will focus on the 
program's implementation. Naturalistic observations 
and interviews will be used to ascertain: 

1 . The effects of the BCTP on curriculum 
improvement, instructional quality, and 
added support services • 
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The attrition pattern of bilingual teachers. 



The instructional and emotional impact of the 
two and one-half hour responsibility assignmen 

How and to what degrae the BCTP is monitored 

How and to what degree school principals 
conduct a needs assessment at their particular 
schools before establishing goals and objectiv 
for their respective BCTPs . 

The relationship between the morale ot the 
bilingual staff and tl\e monetary incentive 
provided for staff • 



Fifteen schools will comprise the study sample. 
Specifically there will be five elementary 
schools, five junior high, and five senior high 
schools . 



Effectiveness Analysis 



Several programs have been instituted in the LAUSD in order to provide 
particular types of assistance to PHBAO schools. These programs were designed 
to improve teacher quality, educational leadership and curriculum. This part 
of the 1982-83 year's evaluation will attempt to assess the overall effectiveness 
of each of these programs. The effectiveness will be determined in relation to 
the fulfillment of objectives as specified for each program. 

1 . Sample 

The sample will consist of the 124 schools drawn during the 1981-82 school 
year. Sixty-four elementary, 37 junior high, and 23 senior high schools 
are involved. Year-round schools are included in this sample. 

2 . Analysis 

Comparisons will be drawn across three areas: 

1. Bilingual Classroom Teacher Program vs. the Urban Classroom T-aacher 
Program 

2. The Year-round Schools vs. the non-year-round schools 

3. The programs within each heading 

3. Me thod 

The evaluation will consist of questions which address eenh program and 
the objectives to be fulfilled. For example, ona of the objectives in the 
Staff Development Program is to improve instructional strategies. One of the 
questions asked of teachers might be: How effective has the Staff Development 
Program been in improving your instructional strategies? Similar information, 
would be gathered for each of the programs. The intent is to determine the 
overall effectiveness of each of the programs. The effectiveness will be judged 
in two different ways: Have the program's objectives been fulfilled? and 
Have the programs improved teacher quality, educational leadership and curriculum? 



Pro^g rams to Improve Teacher Quality 

A total of eight programs were developed and designated by the PHBAO program 
staff to improve teacher quality. The programs are: 

Bilingual Classroom Teacher Program 

Class Size Reduction Program 

Language Acquisition Program 

Leadership Training Team Program 

Maintenance Alteration/Improvement Program 

Staff Development 

Urban Classroom Teacher Program 
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programs to Improve Curriculum 



These eight programs were designed to improve curriculum: 

Computer Assistance 
Curriculum Alignment 
Extended School Day Program 
parent Teacher Conference Program 
project AHEAD 
project Textbook 
Student-to-student Integration 
supplemental Counseling Articulation 

programs to Improve Educational Leadership 

There are two programs which were designed to improve educational leadeirship: 

Administrative Development 
Selection of Department Chairperson 

III. A NALYSIS OF ACHIEVEMENT AND ATTITUDE DATA 
Achievement Data 

The achievement of elementary school students will be measured by the Survey 
of Essential Skills (SES). This is a criterion-referenced test developed by the 
southwest Regional Laboratory and adopted by the District for universal use at 
the elementary level. The Comprehensive Tests of Basic Skills (CTBS) will be used 
to measure secondary student achievement. 

The 1982-83 achievement test data will be analyzed from five perspectives: 

1. Analyse s in relation to norm s - the spring, 1983 PHBAO test results 
will be compared with relevant standards (i.e., at the elementary level. 
District standards for the SES; at the secondary level, national norms 
for the CTBS ) . 

2. Analyses over time - the spring, 1983 scores will be compared with the 
spring, 1981 and the spring, 1982 scores for those schools in the program 
for three or more years and with the spring, 1982 scores for those schools 
in the program for two years. 

Ana lyses by len gth of program implementation - the spring, 1983 scores 
for schools in the program three or more years will be compared with 
the 1983 scores for schools in the program for two years. 
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4- Analyses by type of teacher program - a comparison of the spring, 1983 
test scores of those schools participating in the Urban Classroom Tea cher 

Program and those in the Bilingual Classroom Teacher progr am will' be 

made. Using the same UCTP and BCTP dichotomy, comparisions of scores 
over time and by length of program implementation will be developed. 

5- Analyses b y school schedule - there will be a comparison of spring 

1983 test scores for those schools on regular schedule and those on year- 
round schedules. 

The full range of comparisons (i.e., items 1 through 5, above) will cover 
elementary schools. The range will be somewhat constricted at the secondary level 
given the lesser variation in length of program implementation and school 
schedules 

Attitude Data 



The assessment of the attitudinal changes occurring in the PHBAO students will 
be measured by the School Attitude Measure (Scott, Foresman and Company, 1980) 

School Attitude Measure (SAM) is a norm-referenced test, adopted by the 
District for use with its elementary, junior high, and senior high students. 

The 1982-83 attitude data will be analyzed from two perspectives: 

1- Analyses in relation to norms - the 1982-83 SAM test results will 
be compared with national norms as well as District norms. 

2* Analyses over time - the 1982-83 SAM scores will be contrasted with 

the SAM scores obtained during the 1980-81 and 1981-82 academic years. 
These contrasts will be made in relation to national standardization 
samples . 

The above two analyses will be conducted for the non-Year«Round schools as well 
as the Year-Round schools . 
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IV. TIME LINE 



December 20, 1982 



- Submit Evaluation Plan 



January 1, 1983 
January 10 - 31 , 1 983 



Tiu;. responds to Evaluation 
Pltii/ j.nr3trument3 development 



January 3-28, 1983 



Selection of sample schools 



February 1 - April 16, 1983 



Harms Progress and implemen- 
tation data collection 



March 1 , 1983 



- Mid-year report due 



April 19 - May 31 , 1983 



Analysis and report writing 



June 1 , 1 983 



First draft of Final Report 



June 2 - June 1 1 , 1983 



Evaluation Office review of 
draft 



June 21 - June 29, 1983 



- Revision of Draft Report 



June 30, 1983 



- Final Draft 



October 1 , 1 983 



Final Draft to Court 

and review by LAUSD staff 
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EVALUATION DESIGN 



MED-COR PROGRAM (PHBAO) 
SECTION F 



1982 - 83 
DESIGN FOR EVALUATION 
OF 

UNIVERSITY OF SOUTHERN CALIFORNIA 
SCHOOL OF MEDICINE MED-COR PROGRAM 



John Wright, Bd.D. , Consultant 
September 30, 1983 
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EVALUATION PLAN AND DESIGN 



Med-Cor has been in operation for more than a decade. During that 
period, the program has been consistantly improved and the clientele it serves 
has been changed to include more junior high school students. By increasing 
recruitment efforts in the direction of younger students, it has been 
reasoned that the remedial and support aspects of the program will increase 
the potential for being successful. Evaluations have found that since the 
shift to acquiring participants at an earlier age, a smaller percentage of 
students have dropped out of the program. 

Med Cor continues to be a part of the district's effort to "reduce and 
ultimately remove consequences of racial isolaton'' . Med-Cor embraces three 
specific goals of court approved PHBAO programs to provide students oppor- 
tunity to: (1) improve self esteem, (2) improve levels of academic achieve- 
ment, and (3) allow access to post graduate educational and employment 
opportunities . 

Sufficient evaluations have been done to establish that Med-Cor is a 
successful program and is accomplishing its major objectives at a very 
acceptable level. The 1982-83 evaluation will therefore concentrate on 
monitoring the continued attainment of its goals and will in addition 
attempt to gather input from Med-Cor students about how to improve program 
efforts to meet student needs. 

Following are the questions to which the 1982-83 evaluation will 
seek answers. A chart detailing the source of information and method to 
be used in seeking answers to the questions and a time line of evaluation 
events is attached. 



1 . How successful was the Med-Cor program in 1982-83? 

1.1 Was attrition in enrollment reduced when compared with previous years? 



1982-83 Evaluation Questions 
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1.2 Was attendance improved? 

1 .3 What portion of the June 19B2 graduates pursued college degrees 
and health related careers? (PHBAO Goal) 

How effective were the major components of the program? 

2.1 Tutorial program? 

2.1.1 Were steps taken to make English tutoring more effective? 
2.1.1.1 If taken, were the steps helpful? 

2.1.2 Were steps taken to make the Saturday program more 
interesting to students and more effective in meeting 
their needs? 

2.1.1.1 Did academic achievement improve? (PHBAO Goax) 

2.1.1.2 What do students think the program needs to be 
more effective in meeting their needs? 

2.2 Sumnier program? 

2.2.1 What evidence exists of the success of the summer program? 

2.2.2 Does self-esteem of participants improve? (PHBAO Goal) 

2.2.3 What changes or improvements do students want in the summer 
program? 
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SOURCE ADMINISTERED HOM 

EVALUATION HOW MEASURED INSTRUMENTS PREPARED BY BY PREPARED 



1 . overall success 

1 .1 Reduced attrition 

1 .3 Improved attendance 
1 iS.I Compared with 
previous years 

' ,4 Pursuance of advanced 
study and health 
careers by June 1982 
grads 

2, Eff^^' -'iveness of components 
2.1 Tutorial program 

2.1.1 Steps taken to 
improve 
instruction 
in English 

2.1.1.1 

Success of 
steps 

4.1.2 Effectiveness 
of tutoring 

Steps taken 
to make the 
Saturday 
program more 
interesting 
and helpful to 
students 



Analysis of enrollment 
Exit interview data 
analysis 



Staff records 
Exit interview form 



Table 
Descriptive 



Analysis of records 



Staff records 



Table 



.Analysis of status of Staff records Staff Staff Tables 

June grads in October 

1982 



Interview staff Descriptive 



Question students 


Group Discussion 


Evali'.cor 


EMiuator 


Descriptive 




and Interview 




with Staff 










assistance 










Evalautor 






Group Discussion 




with Staff 




Question students 


and Interview 


Evaluator 


assistance 


Descriptive 


Analysis of test 


Tests 


Staff 


Staff 


Chart of 


scores pre-post 








mean gains 


Interview Staff 








Descriptive 
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SOURCE 

BVALOATION HOW MEASURED INSTRUMENTS PREPARED liY BY PREPARED 



2.1.2.1 Evaluator 

Success of Group Discussion with Staff 

Steps Question Students and Interview Evaluator assistance Descriptive 

2.3 Slimmer Prograii Analysis of SAT test ' Returned Sat scores Table 

Success and needs success 

Analysis of student. Group discussion Evaluator Evaluator Descriptive 
opinion and interview of with staff 

seniors assistance 

"•i 
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TIME LINE OP EVALUATION EVENTS 



October November Deceiaber January February March April 
10 20 30 10 20 30 10 20 30 10 20 30 10 20 30 10 20 30 10 20 30 



Summer Program 
SAT score analysis 
Interview Students - groups 
Analysis of student opinion 
Report 

Status of 1982 Graduates 
Analysis of st?.ff d^ta 

regarding status of 1982 

graduates 
Report 

Success of Program 
Analysis of enrollment 
Exit interview analysis 
Attendance Analysis 

Effectiveness of components 
Tutorial 

Steps taken to improve instruction 

Interview staff 

In te '•view students 

Analysis of student opinion 
Administer tests 
Analyze Test Data 

Pinal Report 
First draft 
Final 



Pre X 




X — X 



1982-83 Evaluation of Med-Cor 
Event Schedule For Med-Cor Staff 
Assistance to Evaluator 



Due Date 

October 20, 1982 

November 1, 1982 

November l , 1 982 

November 20 / 1 982 

November 13, 1983 
November 20, 1983 
February i , i 983 
March 30, 1983 
April 16, 1983 

May 15, 1983 
May 30, 1983 
May 30, 1983 



Item 

Administer fall tests 

SAT score data for summer 1982 

Provide evaluation official enrollment 
count 

Staff record data regarding status (and major 
if college enrolled) of June 1981 graduates 

Assist evaluator in conducting discussion by seniors 

Provide evaluator with test score data 

Provide evaluator with fall attendance data 

Provide evaluator with exit interview data 

Assist evaluator in conducting discussion by 
representative students 

Administer spring tests 

Provide evaluator witli test score data 

Provide evaluator with spring attendance data 
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EVALUATION DESIGN 



SCHOOL READINESS LANGUAGE 
DEVELOPMENT PROGRAM (PHBAO) 
SECTION G 
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EVALUATION DESIGN 
1981-83 



School Readiness Language Development Program: 
A Prekindergarten Program for 
Predominantly Hispanic, Black, Asian, and Other Noti-Anglo Pupils 



Paula Moseley 
Temporary Advisor 



Research and Evaluation Branch, Survey Uhit 
Los Angeles Uhified School District. 
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LOS ANGELES UNFIED SCHOOL DISTRICT 
Reseorch and Evoluation Bronch 



School Roodinoss Umguoge Dovolopmont Progrom 
Evoliration DMign for I9BI-83 

Bockgrowid hformotlon 

In October 1977, a student integration plan titled Integrated 
Educational Excellence Through Choice was submitted to the Superior Court of 
the State of California, Special provisions were included for programs 
designed to meet the needs of students who would attend racially isolated 
schools. CXiring the spring semester of 1979, approval was obtained for the 
implementation of the School Readiness Language Development Program (SRLDP). 

The Crawford decision identified low self-esteem, low academic 
achievement, interracial intolerance, and lack of access to postgraduate 
education and employment opportunities as harmful consequences of racial 
isolation. The SRLDP addresses three of these consequences. The program 
prepares pupils for future success in regular academic school programs 
by providing them the opportunity to acquire needed communication skills. 
Activities for the development of self-image and multicultural awareness are 
included in the Prekindergarten Skills Inventory Profiles developed for the 
program. The direct relationship between the SRLDP and postgraduate 
educational and employment opportunities cannot be determined at this time. 
Recent research, however, states that preschool education contributes to the 
child's success in school and commitment to education, which may result in 
higher educational attainment, occupational status and income.' 

'l. D, Schweinhart and D. P. Weikart, Young Chi Idren Grow Up: The 
Effects of the Perry Preschool Program on Youths through Age 15^ High/Scope 
Press, Ypsilanti, Michigan, 1980, p. 63. [ 
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Children with culturally disadvuntcged bnr:kgrounds often have a poor 

self-image, are linguistically handicapped, and lack the experiential 

background "needed to be successful in school. Language and communication 

skills are vital because they affect academic achievement, vocational 

opportunity and social advancement. When children are able to communicate 

and have been given appropriate experiences prior to starting school, their 

2 

chances for success are improved. 

EVALUATION DESIGN 

The evaluation design includes both implementation and progress data. 
The evaluation is organized around the 10 annotated questions listed below. 
The first 5 questions describe the program implementation. Questions 6-10 
discuss progress dafa. After each question, the evaluation activities used 
for data collection are described. 
Implementation Evaluation 

The implementation evaluation centers around these five questions: 

1 . To . what extent was the SRLDP implemented accordi ng to the plan 
submitted to the court? 

2. To what extent were the recommendations made in th e year-end 
reports implemented dur-nq the follow ing school year? 

3. To whot extent were the rolas ond responsibilit ies of the 
odministrgtors ond advisors of the SRLDP perfor med os pignned? 



^Kenneth Johnson, Teochinq the Culturglly Disgdv gntgoed; A Rgtionol 
Approach, Science Research Associates, Palo Alto, 1970, pp. ZO, 
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Interviews with administrators, survey forms, and observation of 
program activities will collect the data needed to answer questions I 
through 3. A description of where the program was implemented, the number 
of schools in each area, and the criteria for selection of school sites will 
be included. 

What staf f development needs were identified by the orincioals. 
teachers ^ parent education teachers, and aides? To what extent were these 
needs included in the staff development sessions planned for the year? 

A needs assessmc^it survey, questionnaires and interviews with 
administrators will answer question 4. At the first district-wide staff 
development, participants will complete a needs assessment to. determine the 
topics of highest interest. Questionnaires distributed at subsequent 
meetings will be used to determine if the needs of the participants were 
met • 

S» What changes in the program organization and structure were made 
during t he school year? Why were the chonqes made, ond with what results? 

The data regarding changes in the program organization v#ill be 
collected through interviews, observation, and questionnaires. An analysis 
of the purpose of the changes and the results will be included. 
Progress Evaluation 

The progress evaluation addresses these five questions: 

How do t he children in the SRLDP compare academically with other 
preschooUaged children? 
A sampling of SRLDP children will be tested using the Cooperative 
Preschool Inventory. The test results of the SRLDP children will be 
compared with national norms to answer question 6. 
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7 . \A/hn» pr/.qr«.«« HiH children mo ke in school r eadiness skills? 

The progress of the children will be measured using the results of 
the testing program, and a summary of the skills assessed with the 
SRLDP Skills Continuum. 

8. What benefits did the p c"^'^*- H^'^i^/^ fmm the parent education 
program? 

The parent education program will be assessed with guestionnaires 
for participants and their instructors. 

9. How benefici r ! — ^♦"^^ HRvelopment sessions provided for 
teachers and education aides? 

Data collection for the staff development sessions will include 
needs assessment and evaluation form.; completed by the participants. 

10. How did the tenrhPrs. educa tion aides, and area advisorsjnvolved 
in the SRLDP feel about t he program? 

Questionnaires completed by each of the groups listed above will 
be summarized to answer guestion 10. 
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Chapter I 
Introduction 

This document presents a plan for the second year of a two-y|ear 
evaluation of Voluntary Integration and the Year-Round Schools (YRS) programs 
in the Los Angeles Unified School District. Voluntary Integration programs 
include: Continued Integration programs (CIP), Magnets, and Permits With 
Transportation (PWT). Voluntary Integration and YRS programs were outlined in 
the District's plan for desegregation submitted to the Court on June 30, 1981. 

The evaluation plan, submitted by the Evaluation Planning Team in 
l?8l-82, provided the basic framework for the two-year period 1981-83, and was 
guided by policy needs in the District as identified in the District Sub- 
mission 'and subsequent discussions with District staff. The development 
and focus of the 1982-83 plan were guided by the two-year plan as refined, 
based on the findings during the first year and additional discussions with 
District staff. 

The remainder of this chapter includes an overview of the District 
Submission and the specific programs to be examined during 1982-83, as well 
as, a description of the overall evaluation framework plus anticipated 
products and timelines for the study. Chapters II and III describe the 
methodology to be used in examining the Voluntary Integration programs (CIP, 
Magnet, PWT) and the Year-Round Schools program, respectively. Where 
appropriate, relevant sections are repeated from the 1981-82 evaluation plan. 

The Los Angeles Unified School District submitted its plan for 
desegregation on June 30, 1981, in response to a Court ordered mandate 
to take reasonably feasible steps to alleviate segregation and its accompa- 
nying harms., This Submission focused on the 1981-82 school year but was 
also intended to serve as a plan for integration in the District over the next 
several years. Three goals were identified in the Submission: 

1) To provide the maximum number of predominantly Hispanic , Black, 
Asian, and Other non-Anglo (PHBAO) students with the opportunity to 
attend school in a desegregated setting. 

2) To preserve the integrated nature of schools and neighborhoods that 
have achieved this status through residential integration and 
programs for voluntary integration. 
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3) To alleviate the harmful effects of racial isolation for thoVe , 
students who will remain racially isolated because of the 'Y's/ricts 
predominantly Hispanic, Black, Asian, and Other non-AngIb (PHBAO) 
enrollment. \ 
The District Submission contained several program components encompassing 
all schools in the District according to their classification as participxints 
in: I) Con^:'ec\ Integration programs (CIP), 2) Magnet School programs,^ 
3) Permits With 'transportation (PWT) program, 4) predominantly Hispanic, 
Black, Asian, and Other non-Anglo (PHBAO) school programs, and 5) Year-Round 
Schools program. 

The District Submission olso contained an evaluation component designed: 
I) to assess the effectiveness of the Voluntary Integration programs; 2) 
to analyze the Year-Round Schools program; and 3) to provide an ongoing 
review of the District's progress toward alleviating the harms of racial 
isolation. To assist with this effort, an Integration Evaluation Planning 
Team of five outside consultants was established to work in cooperation with 
the District's Research and Evaluation Branch. (A separate team of 
consultants was established to conduct the evaluation study of PHBAO school 
programs. A separate report was prepared for 1981-82 and is planned for 
1982-83.) 

Voluntary Integration Progranw 

Voluntary Integration programs are designed to maximize the number of 
predominantly Hispanic, Black, Asian, and Other non-Anglo (PHBAO) students who 
have an opportunity to attend desegregated schools. Programs in this category 
include: 

Continued Integration programs (CIP) 
Magnet School programs 

Permits With Transportation (PWT) program 

Continued Integration Programs 

Continued Integration programs (CIP) allow students who participated in 
pairs and clusters under the mandatory desegregation program to continue their 
relationship by: I) continuing to attend on a Continued Voluntary Permit 
(CVP) the school, with which their resident school was paired or clustered 
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during the 1960-81 school year; 2) participating in inter-school projects with 
pupils from formerly paired or clustered schools; and 3) participating in 
planned inter-school activities focusing on enhancing leadership skills. One 
hundred end fiffy-three schools were eligible to particij^ate in CiP during 

1981- 82 and 1982-83. However, this study will focus only on the CVP program 
component of the CIP programs. 

Magnet School Programs 

Magnet schools and centers were established to give students the 
opportunity to attend an integrated school with a specialized curriculum 
offering. Magnet programs include full school magnets and magnet centers 
located on regular school campuses. Magnets are organized around a particular 
subject field or may offer a unique instructional design. Eighty-four magnet 
schools and centers opened in September 1981, with an enrollment approaching 
18,000 students. Eighty-six magnet schools and centers are operating during 

1982- 83 with an approximate enrollment of 20,462. 

Permits With Transportation (PWT) Program 

The Permits With Transportation (PWT) program gives students the 
opportunity to transfer voluntarily from specified schools in one area of the 
District to designated schools in other areas. Transportation is provided. 
The purposes of PWT are: 

to provide a desegregated education for students 

to reduce racial isolation 

to relieve overcrowding 

to provide for more effective utilization of classroom space 
Participating students become a part of the receiving schools for all 
purposes and have the same privileges and responsibilities as resident 
students. In 1981-82, virtually every school with a White enrollment of 40% 
or greater (136 schools) was eligible to be a PWT receiving school. Nineteen 
thousand two hundred and eighty-one predominantly Hispanic, Black, Asian, and 
Other non-Anglo (PHBAO) students participated during 1981-82. During 1982-83, 
there were 137 PWT receiving schools and 20,686 PHBAO students participating. 
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Ycor-Round S chos is 

The District Submission and District personnel indicated that over- 
crowding is one of the most critical problems facing the District. The Year- 
Round Schools program was established as one of the District's responses to 
overcrowded schools. During 1981-82. there were 90 schools operating on year- 
round calendars serving 119.016 students. The number of schools operating on 
year-round schedules grew to 95 with a lotal of 124.195 students enrolled 
during 1982-83. 

The District utilizes the 45/15. 90/30. and Concept-Six scheduies for 
year-round education. With the 45/15 schedule, a pupil is in school for 45 
days (9 weeks) followed by 15 days (3 weeks) of vacation. With the 90/30 
schedule a pupil is in school for 90 days (one traditional semester) followed 
by 30 days of vacation (one-half of the traditional vacation). With the 
Concept-Six schedule a pupil is in school for 163 days. 390 minutes per day as 
contrasted to 176 days, 360 minutes per day in the traditional calendar or as 
in the 90/30 year-round secondary schools. 

Table I- 1 presents the approximate number of schools and students 
participating in the Voluntary Integration and YRS programs during 1981-82 and 
1 982-83 

Since the Voluntary Integration programs and the Year-Round Schools 
program differ substontively in purpose, the two-year evaluation plan treated 
them as two separate studies. 

Chapter II of this plan includes the methodology and evaluation design 
for the Voluntary Integration programs, while Chapter III gives similar 
information for the Year-Round Schools study. Each chapter provides a 
conceptual framework for the evaluation effort to be undertaken, including 
sampling methodology, instrumentation, data collection strategy and ffT^elme, 
and data analysis techniques to be used. 

Programs for both voluntary integration (CIP, Magnet, and PWT) and Year 
Round Schools (YRS) were examined during 1981-82 and will continue to be 
studied during 1982-83. Consistent with the priorities and policy concerns 
expressed by District personnel, the Team placed greater emphasis on the 
Voluntary Integration programs during the first year. More specifically, 
in addition to the Team's primary data collection, a university sub-study was 
commissioned to conduct in-depth interviews of parent end student 



o 

ERIC 



Table I- 1 

^4u^^e^ of Schools and Students: 1981-82 and 1982-83 



1981-82 1982-83 

Programs Schools Students Schools Students 



Continued 

Integration 153* 75,209* 79** 2,m2** 

Magnets m 17,686 86 19,102 

Permits With 

Transportation 136 18,876 137 20,686 

Year-Round 

Schools 90 119,016 95 i2'l,l95 



Total 463 230.787 397 166,825 



*Number of schools and students eligible to participate in the Continued 
Integration programs (CIP) including the Continued Voluntary Permits (CVP) 
program. 

**Number of schools and students participating in the Continued Voluntary 
Permits program. 
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understandinqs of the pror)rams. During 1932-83 greater emphasis will be 
placed on the Year-Round Schools (YRS) study, as proposed in the two-year 
plan. The Team still feels this deployment of its limited resources is 
consistent with the District's expressed information needs and is sensitive to 
the formative nature of the YRS program. 

Anticipated Products and Timelines 

Table 1-2 shows the proposed products and timelines for Voluntary 
Integration programs study and the Year-Round Schools study, respectively. 

This timeline was jointly agreed upon by Team members and District staff. 
It provides for midyear reports of operational progress to be submitted in 
April 1983, and initial drafts of final reports in June 1983. This timeline 
allows for review by the program staff and the incorporation of achievement 
test data over the summer, with final reports to be submitted by the Team to 
the District on September 20, 1983. 



Table 1-2 
Products and Tinnelines: 1983 



Program staffs* written reactions to the 
evaluation design 

Instrumentation development and review 
by program staffs 

Midyear progress reports (operation reports) 
Initial drafts of final reports 
Final drafts of final reports 

Program staffs' written reactions to the reports 
Final reports 

Submission of reports to the Court 



January 7 

January 10-31 
Aoril I 
June I 
June 30 

July I - August 31 
September 20 
October I 
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Chopter li 

AAethodology: Voluntory Integroticn Programs 



Purposes ond Issues 

As stated in the two-year plan, the primary ourposes of the studies of 
the Voluntary Integration programs are to provide information on the 
measures taken and progress achieved by these programs. As such, these 
purposes require an evaluation of "process" or the actions taken within each 
program under the present conditions and of the "outcomes" or the impact on 
students. Thus, the first step in formulating an evaluation design for the 
voluntary integration effort involved identifying the important "processes" 
ond "outcomes" for the three programs under study: Continued Integration, 
Magnet, and Permits With Transportation (PWT). 

The Team relied heavily on previous formulations and findings in order to 
assure continuity between the 1981-82 and 1982-83 efforts. In addition, the 
Team received direction from District staff on the relative emphasis on 
process and outcome in the studies. In defining important dimensions of 
program process, the Team continued to direct its efforts using both the 
statements of program purpose previously derived from program literature and 
discussions with key District personnel. (See Table ll-l.) Each of the three 
Voluntary Integration programs is designed to provide a mechanism for 
desegregation /in teg rat ion . The Magnet programs provide these experiences 
focused around special interests while the PWT program provides them within 
the regular school program . Although not directly reflected in the 
statement of program purpose, the CIP relies on the regular school for the 
Continued Voluntary Permits (CVP) program. 
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Table II- 1 

Voluntary Integration Programs: Stated Purposes 



Programs 



Purpose 
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Magnet 



Permits With Transportation 



Continued Voluntary Permits 



To provide a mechanism for voluntary 
integration focused around special 
interests. 

To provide a mechanism for voluntary 
participation in a desegregated 
regular school program. 

To provide a mechanism for positive 
integration experiences for students 
previously engaged in mandatory 
desegregation programs. 



Second, the Team refined the inguiry into program process based on the 
findings of the 1980-81 studies as well as the views of District adminis- 
trators about areas of concern. In some cases, this involved curtailing the 
collection of data on issues which were judged to be satisfactorily addressed 
in previous studies, such as the demonstration of the fidelity of Magnet 
programs. In other cases, continuation of previous data collection was called 
for with issues of ongoing concern, such as the educational opportunities of 
PWT students within their resident schools. Finally, in other cases, the 
focus was expanded to include emerging issues of concern such as the post- 
secondary advising of magnet students. 

In defining the important "outcome" areas to be addressed, the Team 
relied primarily on direction from the Cour' . ruur harms associated with 
racial isolotion were identified in the Craw. or case: I) academic 
u.-hievement, 2) attitudes, 3) post-secondary opportunities, and 4) intergroup 
interaction. Progress toward the reduction of these harms was maintained as 
an area of inguiry in the evaluations. 



-8- 



1 - 



The above processes led to the formulation of a set of evaluation Issues 
to guide the studies during 1982-83. These issues are presented in Section A 
of Table 11-2 for the process component of the evaluation and Section 3 of 
Table 11-2 for the outcome component. In most cases, the issues apply across 
all programs. In some cases, the issue applies to a particular program or a 
particular program component, depending on the context in which the program 
operates. These restrictions are noted accordingly in the table. 

It should be noted that the evaluation issues related to process are 
divided into three main categories: I) program mechanism, 2) desegregation/ 
integration policies and practices, and 3) school practices. The first two 
categories are derived directly from the statements of program purposes. "he 
issues related to the program mechanism examine shifts in District procedures 
for presenting programmatic offerings to parents and students. Further, the 
ultimate results of the mechanism, that is, the characteristics of partici- 
pating students and schools, are also delineated. The issues related to 
desegregation/integration go beyond the assignment of students, to examine the 
policies and procedures that contribute to positive and meaningful integrated 
interactions both inside and outside the classroom. Futhermore, the 
importance of staff perceptions and attitudes and '^actions taken to address 
ongoing concerns ere recognized and targeted for further inquiry. 

The third category is derived from the context in which the programs 
operate. Regular school practices refer to efforts taken to incorporate the 
student into the regular school program where appropriate and to accommodate 
the needs of program participants. The issue related to outcome explicates 
the four harms identified in the Crawford case and inquires into the degree of 
progress made toward their reduction. 

The evaluation issues in Table 11-2 provide the conceptual framework for 
the design of the evaluation methodology. More specifically, they guided the 
preliminary substantive decisions about sampling, instrumentation, data 
collection, and data analysis outlined in the subsequent sections of this 
plan. Futhermore, the iss will also guide the refinement and 
implementation of study method*: and procedures. 
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Table IU2 

Voluntary Integration Programs: Evaluation Issues 

1982-83 



Proqroms 



Evaluation Issues 



Magnet PWT CVP 



A. Process Evaluation 

I . Mechanisms 

a. What changes have been made in 
mechanisms for explaining program 
options to parents and stude.nts 
during 1982-83? 

b. What are the characteristics of 
students chosen to participate? 

c. Do program mechanisms result in 
students being enrolled in 
desegregated schools? 

1. Integration/Desegregation 

a. How do policies and procedures inhibit 
or contribute to integration? 

L administration 

2. classroom 

3. extracurricular 

b. What types of services are delivered 
as part of the program? 

c. What are the perceptions and attitudes 
of school personnel toward the program? 

d. What additional arrangements have been 
undertaken during 1982-83 to address 
particular areas of concern? 



3. School Program 
a 



b. 



What efforts are made to encourage the 
incorporation of transfer students into 
the regular school program? 
What actions are taken to accommodate 
the needs of program participants? 



X 
X 



X 

X 



X 
X 



X 
X 



X 
X 



X 
X 



X 
X 



X 
X 



B. Outcome Evoluatian 

I . What progress appears to have bee n made in 
reducing the harms set forth by the Court in 
the Crawford decision ? 

a. Achievement 

b. Attitudes 

c. Post-secondary opportunities 

d. Social interaction 



X 
X 
X 
X 



X 
X 
X 
X 



X 
X 
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The Team proposes continuing the nnulti-level approach to data collection 
depending on the nature and availability of the desired information. These 
levels vary from a complete census of the entire population of schools to a 
more intensive study of a small number of selected sites. More specifically, 
three levels ore envisioned: i) census of the entire population on data such 
as demographic characteristics, 2) a survey sample, and 3) a smaller 
observation sample. This approach is described in greater detail in the 
following sections. 

Sompiing 

The sample of schools selectee^ for the 1981-82 study will be maintained 
during the 1982-83 study with a few minor adjustments. This approach will 
help assure continuity and comparability of data over the two-year period. 
The following paragraph provides an overview of the approach initially used in 
sampling procedures, developed for the 1981-82 study which will be continued 
this year. Deviations from previous procedures planned for 1982-83 are noted, 
as appropriate. 

While separate samples were drawn for the 1981-82 study of the CVP, 
Magnet, and PWT programs, the approach to their sample selection was largely 
identical. In each case, a stratified random selection of schools was 
employed. The choice of stratification dimensions was a result of the 
specific programmatic thrust and is discussed in the following subsections for 
each program. The size of the school sample for the different programs 
reflects limitations proposed by available resources and the relative priority 
of the programs for study. Further, it should be noted that information on 
selected demographic characteristics will be gathered for the complete census 
of schools in each program at selected grade levels. The following 
subsections also describe the procedures for selecting samples of teachers and 
students in participating schools. The sampling procedures used with Magnet 
programs is presented first, followed by a discussion of the sampling of PWT 
and CVP schools since the procedures for the latter two programs closely 
parallel each other. 
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Magnet School Programs 

During the 1981 82 school year, 84 Magnet programs operated m the 
District. They represented a variety of educational programs, student 
populations, grade level configurations, and physical locations. In 
developing the sampling strategy for these programs, the Team built upon the 
results of the 1980-81 evaluation as well as the issues raised subsequently by 
the Court and the District. Four areas were identified as particulorly worthy 
of investigation: I) the effects of different programmatic offerings, 2) the 
influence of the racial/ethnic composition of the magnets, 3) the influence of 
length (time) of existence as a magnet, and 4) the impact of the locat.on of 
the magnet within the District. 

To maximize the Team's ability to study these areas, it was decided to 
employ a sampling strategy that would utilize stratification dimensions 
implied by these areas. For example, the influence of programmat.c thrust 
could be studied by stratifying the magnets according to program type. Based 
on the 1980-81 study of Magnet programs, magnets were classified mto program 
types, such as: content-oriented, process-oriented, or special populat.on. 

The effects of the racial/ethnic composition of the magnets were 
investigated by stratifying the programs with respect to the percentage of 
non-White students. Magnets were considered as desegregated .f the 
racial/ethnic composition of their students was 40 to 60% non-White or 
racially impacted if their student composition was greater than 60% non-Wh.te. 

Since nineteen of the twenty new Magnet programs were at the senior high 
school level, the Team decided that it would be best to draw separate samples 
at each grade sr.on to insure adequate representation of new programs. Thus, 
three separote samples were drawn: one at the elementary school level, one at 
the junior high school level, and one at the senior high school level. 

The physical location of the magnets was not used as a stratification 
dimension because the number of sampling cells would exceed the total sample 
size Futhermore, the matrix composed of program type, rac.al/ethn.c 
composition, and grade level seemed to insure an adequate and comprehensive 
range of locations in the resultant sample. The sampling matrices resultmg 
from this process are presented in Tables 11-3 through 11-5. 



. -12- 

160 

o 

ERIC 



Originally, it had been proposed that a sample of magnets be included 
in the 1981-82 evaluation. However, after examining the resultant sampling 
matrices, it was decided that a total of magnets should be sampled. This 
number allowed the resultant sample to include at least one site per sampling 
cell and to include all those magnets studied in the previous year (1980-81). 
The decision to include the sites from the previous year was based upon the 
desire to capitalize on the previous data collection and to create a 
longitudinal profile for some of the magnets. As a result, 25 elementary 
magnets (IS from the former sample), 10 junior high school magnets (five from 
the former sample), and nine senior high school magnets were sampled. (All 
magnets at this level were new and were included in the sample.) It should be 
notec! that all the magnets from the former sample were of the desegregated 
type since the 1980-81 study was only concerned with programs addressing a 
racially balanced population. 

The sampling of teachers and school staffs within the magnets was also 
conducted through stratified random sampling. In this case, the 
stratification dimensions were grade level and academic subject matter. 
Because of the intei*est in all levels of the educational process, pivotal 
grode levels were selected to represent the entire process, specifically, 
grades 5, 6, 8, 10, and 12. The sample of secondary teachers was selected, 
both from academic and non-academic subject areas. Employing the same 
sampling procedures as the 1980-81 study resulted in a sample of teachers of 
English and physical education, or other non-academic subjects. English was 
selected because of its role as a core subject in the secondary curriculum. 

It is proposed that the 'same sample of Magnet programs, identified 
according to the procedures described above, be included in the 1982-83 study. 
In addition, it is proposed that grade 12 students in the two Magnet programs 
containing students at this grade level be included in the sample so that 
post-secondary plar^s (at least of the small group of relevant program 
participants) may be examined. 



PWT Program 

The examination of the PWT program has focused on the receiving schools, 
that is, schools to which PWT students are transported. Because of the 
potentiol importance of the feeder patterns between schools of the various 
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Table IU3 

Sampling Matrix for Elementary Magnet Schools 



Progrom Type 



Total Number of 
Desegregated 
Magnets 



Total Number of 
Number Racially Impacted Number 
Sampled Magnets Sampled 



Content Oriented 

Center for Enriched 
Studies 
(N = 3)* 

Other 

(N = 10)* 

Process Oriented 

Alternative 
(N = li)* 

Fundamental 
(N = 10)» 

Special Population 

Gifted 
(N = 12) 

Highly Gifted 
(N = li) 



3 
7 



3 
6 



9 
3 



I 

3 
2 

5 
2 



I 



3 
I 



I 

2 



Totals 31 17 12 

* A total of ten extended schools are included in the various program types. 
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Table 11-4 

Sampling Matrix for Junior High Magnet School 



Total Number of Total Number of 

Desegregated Number Racially Impacted Number 
Program Type AAognets Sampied Magnets Sampled 



Process Oriented 

Fundamenlal 
(N = 3) 



Special Population 
Gifted 

(N = 3) 5 2 

Highly Gifted 

(N = 2) 2 I 



0th 



er 



(N = 6) 



Totals 12 



ERIC 



■15" 



163 



Table 11-5 

Sampling Matrix for Senior High ^Aagnet Schools 



Program Type 



Total Number of 
Desegregated 
Magnets 



Number 
Sampled 



Total Number of 
Racially llmpocted ^f^^. 
Magnets Sampled 



College Incentive 
(N = 8) 



Math/Science . 
(N = 6) 



Performing Arts 
Visual Arts 
(N = 3) 



Humanities/Other 
(N = 7) 



Totals 



16 



ERIC 



-16- 



164 



grade levels, it was decided to perform a linked sampling procedure across 
grade level configurations. This sampling approach allowed the Team to study 
the transition of PWT and non-PWT students as they progressed through the 
normal receiving school feeder patterns. 

Implementation of this strategy required stratified random sampling at 
the senior high school level. Then, for those senior high schools selected 
into the sample, c random sample of their feeder junior high schools was 
drawn. Finally, for those junior high schools selected, a random sample of 
their feeder elementary schools was selected. The only additional constraint 
placed on the junior high schools and elementary schools selected into the 
1981-82 sample was that they also be PWT receiving schools. Lastly, the 
feeder schools were selected with probability proportional to the percentage 
of their students being sent to the school at the next grade level. That is, 
a junior high school's probability of selection was based on the percentage of 
its students which would be sent to the senior high school that had been 
selected into the PWT sample. This approach insured that the sample school 
had sizeable numbers of students from their feeder schools sampled at the 
lower grade levels, 

A total sample of PWT receiving schools was selected for the 1980-81 
and 1981-82 study. There were II senior high schools, 15 junior high schools, 
and 18 elementary schools. The senior high schools were selected based on the 
percentage of PWT students in the school and the percentage of PWT students 
that were Black, Three of the selected elementary schools were closed by the 
District in 1982-83 due to their underenrol Iment , This reduced the 1982-83 
elementary school sample to 15 and the total sample to ^1 schools. The junior 
and senior high school sample size remained the same as in the previous years. 
The matrix for the senior high school sample is presented in Table 11-6, The 
junior high schools and elementary schools sampling matrix contained 
variations along these same dimensions. 

Teacher and school staff samples were also selected using a stratified 
random sampling at the torget grade levels, as described in the previous 
section. It is proposed that the PWT sample identified, using the procedures 
described in the preceding section, be continued for the 1982-83 study. 



Table 0-6 

Sampling Matrix for PWT Racelving Senior High Schooli 
PWT Ethnic Enrollment 



Percent of Receiving 






Percent, of PWT Enrollment 


Rircent of PWT Enrollment 


School Enrollment thet 


Percent of PWT Enrollment 


20% or more Nipenlc end 


20% or more Aaian and 


ii PWT 




70% or more Black 


leu than 70% Black 


leti than 70% Black 








Ndi Schooli 




No. SchooU 


Nd. Schooli 


Pftrcwl 


f>to. School! 


No. Schools 


In Sample 


No. Schools 


In Sample 


No. Schooli In Sample 


0-10 


4 


4 


2 








11.20 


11 


9 


2 


2 


2 




21-30 




2 


2 


1 


1 


1 1 


31-40 


1 


1 


1 








Total 


20 


16 


7 


3 


3 


1 1 
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Continued Integrotion Programs (CIP) 

The treatment of the schools involved in the CIP largely paralleled that 
employed for the other Voluntary Integration programs. A sample of 23 schools 
was selected for participation in the 1981-82 and 1982-83 study. Selection of 
these schools was performed through stratified random sampling using three 
stratification dimensions: grade levels (elementary and junior high schools), 
participation in the CVP program, and a measure of program intensity. The 
latter factor was regarded as particularly important, since services, 
particularly those lov/ in intensity, would be difficult to accurately gauge 
and investigate. Measurement of intensity level was based on the number of 
student participants, with ^'high" intensity programs having at least fifty 
participants in the CVP program, "medium" intensity having 30 to 49 
participants, and "low" intensity having less than thirty participants. All 
elementary schools that participated in both PWT and CVP programs were 
excluded from this sample so that potential confounding of the two programs 
would be eliminated. A random sample of six elementary schools from each 
intensity category (see Table 11-7) was selected for study. All five 
participating junior high schools were included in the study. Three of the 
selected junior high and three elementary schools were dropped from the 
1982-83 study due to low CVP student enrollment, resulting in a sample of 17 
schools . 



Instrumentation 

Specifications for instrumentation were guided by the evaluation issues 
developed and presented earlier in Table 11-2 and by instrumentation specifi- 
cations developed for the 1981-82 study. Each issue was examined by the Team 
and the variables, measures, and data sources required to address each issue 
were refined as appropriate. The result of this process is summarized in 
Table 11-8. 

These specifications require a number of separate instruments as listed 
below: 

. Abstracts: Application Data 
Enrollment Data 

Site Administrator Questionnaire 
. Teacher Questionnaire 

College Advisor Questionnaire 

Student Post-Secondary Expectation Questionnaire 
. Social Interaction Observation Form 
Published measures for students: 

- Comprehensive Tests of Basic Skills (CTBS) 

- Survey of Essential Skills (SES) 

- District Competency Tests 

- School Attitude Measure (SAM) 




Table 0-7 
CVP Elementary School Sample 



KL -J, X n. . . ^^'^^^^ PWT and CVP Schooh 

f*jmber of CVP Participants CVP Schools CVP Schools in San^)le (Excluded from SaiTf)le) 



Less than 30 14 ^ 3q 

30-^9 11 6 8 

Greater than 50 7 /; o 



0 



1/0 
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The abstracts will provide information on the characteristics of students 
drawn to the programs and the extent to which the selection mechanisms yield 
desegregated environments. Separate abstracts will be completed for each 
program, however, the variables on which data are collected will be parallel. 

Questionnaires for site administrators, teachers, and college advisors 
will provide data on policies and practices related to deseqregration/ 
integration, in general, and to specific areas of concern, such as 
college/career advising. While the wording needs to be altered somewhat 
across programs, questionnaires for site administrators, teachers, and college 
advisors will be kept parallel across programs to the extent possible. 

The remaining instruments will be used to assess student outcomes. 
Achievement outcomes will be measured by instruments currently in use as part 
of the District's regular testing program: the Comprehensive Tests of Basic 
Skills (GTBS), the Survey of Essential Skills (SES), and District competency 
tests (SHARP, TOPIC, and WRITE:SR). Student attitudes toward school will be 
assessed using the School Attitude Measure (SAM) used for the past two years. 
Pos^-secondary opportunities will be assessed using a questionnaire for 
students eligibility and expectations used during 1981-82. Finally, the 
Social Interaction Observation Form used with success for the past two years 
will be used as a measure of quantity and quality of interqroup interaction. 

DotQ Collection 

Data collection will be managed by the LAUSD Research and Evaluation 
Branch staff. These activities will be conducted from December through June, 
vOS summarized on the schedule presented in Table 11-9. 

Data collection will involve the following tasks: 



completion of abstract forms 

start-up tasks involving notification of sample schools and 
preparation for data collecting 

distribution, collection, and quality control of Site 
Administrator, Teacher, College Advisor, Student Post -Secondary 
Expectation questionnaires 

completion of observations at ecch sample school for each 
specified setting on two separate days 

distribution, training, collection, and quality control of 
School Attitude Measure administration 

. collection of school-level (by grade) summaries of CTBS and SES 
scores and competency test results . 
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Table 11-8 

Voluntary Integration Programs} Instrumentation Specifications 



Evaluation Issues Addressed 



Variables 



Measures 



Data Source 



A. Process Evaluation 



to 
to 



L Mechanism(s) 

a. What changes have been made Content and medio 

in mechanisms for explaining of program infor- 

program ootions to parents motion dissemination 
and students during 1982-83? 



b. What are the characteristics 
of students chosen to 
participote? 

c. Do program mechanisms 
result in students being 
enrolled in desegregated 
schools? 

2. Integration/Desegregation 

a. How do policies and 
procedures inhibit or' 
contribute to integration? 



b. What types of services are 
delivered as part of the 
program? 
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c. What are the perceptions 
and attitudes of school 
personnel toward the 
program? 



Rcce/ethnicity 
Sex 

Grade level 

Race/ethnicity 
Sex 

Grade level 



Administrative 
policies/procedures 
Classroom practices 
Extra-classroom 
practices 

Nature of services 

Intensity 

Duration 



Attitudes towards 
program 



District Documents 
Questionnaire 



Abstract 



Abstract 



Questionrsoire 
Interview 



Questionnaire 
Interview 



Questionnaire 
Interview 



District end 
school admini- 
strators 



District 
documents 



District 
documents 



District Admini- 
strators 

Site Amini- 
strotors 

Teachers 

District Admini- 
strators 
Site Admini- 
strators 
Teachers 

Site Admini- 
strators 
Teachers 
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Tsblf; U (continwd) 
Voluntiry htegration fHgraro: htrumentitlon ^ificatiom 



^^iluation ktm AddreMed 



Viri^let 



d. What additional arrangements Areas of concern 
have been undertaken during Action undertaken 
1782-83 to address particular 
areas of concern? 



3. Sctwol ftogrim 

a. What efforts are made to 
encourage incorporation of 
transfer students into the 
regular school program? 

b. What actions are taken to 
accommodate the needs of 
program participants? 

B. Quteomo Evaluition 

1. What progress appears to have 
been made in reducing the (larms 
set forth in the Crawford 
decision? 



Administrative 
policies/procedures 
Classroom practices 



Administrative 
policies/procedures 
Classroom practices 



HBaiurat 



Questionnaire 



Questionnaire 



Questionnaire 



DitaSourco 



Site Administrators 
Teachers 



Site Administrators 
Teachers 



Site Administrators 
Teachers 



a. Achievement 



b. Attitudes 

c. Post -secondary 
opportunities 



d, Social behavior of 
students toward other 
ethnic groups 



Basic skills 
(reading and math) 

Student attitudes 

Academic preparation 
Post -secondary 
eligibility 
Post -secondary 
expectation 

Student intergroup 
relations 



SES, CTBS 



SAM 



Students 



Students 



Competency tests Students 
Questionnaire Students 

Questionnaire Students 



Observation form Schools 



Table 11-9 
1982-83 Oato Collection Schedule for 
Voluntory Integrotion Progrorm 



Timeline 

Talk Dec. Jon. Feb. Morch April May June 



Complete abstracts of 
archival data 

Prepare introdi;ctory 
letters to region 
superintendents 

Order SAM materials 

Prepare mailing labels 
and other ancillary data 
collection materials 

Schedule sites for 
observation 

Train observers 

Send introductory letters to 
region superintendents and 
principals of sampled schools 

Distribute and collect site 
Administrator, Teacher, and 
College Advisor Questionnaires 

Conduct observctionx 

Administer SAM and Post-Secondary 
Expectation Questionnaire 

Maintain quality control of the 
administration of the questionnaires 
and SAM and prepare for keypunching 

Collect District summaries of 
achievement data 



Dec- Jan> May -June 

Dec. 
Dec> 

Dec> 

Jon. 

Jan . 

Jan > 

Mid-Feb. 
thru March 

Feb.- March 




May -June 



-24- 



ERIC 



Anolysis 



The analysis of information collected during the evaluation of each 
program will produce summary indicators of the degree to which each program 
has been implemerited to meet its specified purpose. Additionally, the 
analysis will examine indications of the extents to which progress has been 
made in reducing the Court-identified harms. It is anticipated that 
separate but parallel analyses will be performed for the four programs. 

The nature of the analyses will be largely descriptive with a heavy 
reliance frequencies, cross-tabulations, and measures of central tendency 
and dispersion. Meaures of association such as correlation will be used to 
help identify factors that are related to program success. Where appropriate, 
comparisons employing techniques such as t-tests or analysis of variance will 
be used to contrast different programmatic features. 

Examination of program outcomes, generally, requires the identification 
of appropriate benchmarks against which the performance of program 
participants is compared. In the case of Voluntary Integration programs, 
potential conclusions about program outcomes are already tentative due to: 
the voluntary nature of the programs; the recent establishment of some 
programs; and recen* innovations in some of the more established programs. 
Thus, given the potential misuses of program and comparison outcome data, only 
a limited set of comparisons is planned. 

In examining achievement and attitude outcomes, the performance of 
program participants will be compared to that of program cohorts studied in 
the previous year, to District averages, and to national percentile ranks. 
These comparisons will provide a measure of change over time as well as 
indications of relative overall standing of program participants. 

Results depicting post-secondary opportunities and intergroup interaction 
will be compared to those .obtained in previous years since the measures used 
were designed, specifically, for this study; and the Team is primarily 
interested in examining trends over time. 

In the reporting of results, every effort will be made to provide concise 
and readily understandable statements of the findings. Charts, graphs, and 
other figures ro help convey the analytic results will be used. The Team 
believes that this approach is consistent with the audiences to be served by 
these reports. 
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CtKipter III 
Mefhodologys Yeor-Round Scheols 



f^M'poMt and Issues 

The plan for the evaluation of the Year-Round Schools (YRS) program for 
1982-83 derives from policy issues of interest to the LAUSD related to the 
operation and effects of YRS, Thus, as with the Voluntary Integration 
programs, our efforts will emphasize evaluating the processes or actions 
undertaken by LAUSD and what has been accomplished, or the outcomes of the YRS 
effort. In some ways, YRS presents a unique evaluation problem. On the one 
hand, the YRS program may be characterized as an administrative response to an 
administrative problem: finding places for children in school settings 
conducive to learning. The YRS response represents an attempt, within legal 
and financial constraints, to use buildings more economically by raising the 
total capacity of the school through changes in the schedule to accommodate a 
greater number of students. YRS could conceivably employ the same 
instructional program as schools on more traditional calendars. Therefore, 
the YRS option may appear to be a management tool rather than an educational 
program. Yet, it is undeniable that the year-round or any other schedule 
exists primarily as a mechanism to contribute to the learning of students. 
While as a matter of emphasis, YRS should be judged according to how its 
processes work in relieving the harms of overcrowding, the impact of the 
experience on students, school personnel, and the community must also be 
addressed. These outcomes are important so the LAUSD can adapt, as necessary,, 
its policies and practices. 

For this evaluction plan, the Evaluation Planning Team was assisted by 
discussions held with region superintendents, parents, school personnel, and 
LAUSD staff in Fall, 1982. The Team has adapted questions for inquiry based 
upon preliminary findings of the 1980-81 and 1981-82 studies. Information 
from these various sources has been reviewed and has resulted in some 
modification of our original study design. We are emphasizing good 



Interviews were conducted as part of a study of YRS Concept-Six schedule. 
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descriptive information about the operation of YRS, the actions undertaken by 
LAUSD to meet schoo! needs, and the progress of the effort as a whole. In the 
area of processes, the Team will study differences between YRS and comparable 
schools in an effort to determine similarities and differences. An 
instructional sub-study will be conducted to compare the instructional program 
in Year-Round Schools and similiar non-Year-Round Schools. 

Because of concerns with the reliability of the findings and the 
adequacy of the data collected in a survey of YRS parents this year's study 
will devote attention to understanding more fully parental concerns 
through a special sub-study. 

In the analysis of the outcomes of the YRS program, this year's study 
will focus on areas identified in the Crawford cose: I) academic achievement; 
2) student attitudes; and 3) post-secondary opportunities. Clearly, an 
important study question involves whether the YRS program actually reduce 
overcrowded educational conditions. Although our previous data show that 
year-round scheduling does reduce overcrowding, we will continue to monitor 
this issue. 

The above analyses have resulted in the plan herein prest^nted to guide 
the evaluation study of YRS for 1982-83. The questions underlying the data 
collection and analyses proposed are presented in Figure lll-l. These 
questions may be placed into three major categories: I) Do the YRS mechanisms 
operate to reduce overcrowding? 2) What is the context in which the program 
operates? 3) How con school level YRS processes and effects be understood? 

In order to answer these questions, the Team will supervise the 
collection of data from school personnel, including principals and teachers, 
and students. As in the study of the Voluntary Integration programs, we 
intend to employ a multilevel approach to data collection, in order to 
conserve resources, as well as to enrich our understanding of the obtained 
information. Data will be collected at four levels: I) census of YRS 
population to determine school enrollments and demographic characteristics of 
students; 2) survey sample of school personnel; 3) outcome and observation 
data for students in YRS and matched comparison schools; and 4) interview data 
to obtain connmunity views on the YRS program, including needs remaining for 
attention. 
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Figure 111*1 
EvQiuotion ApproQchi Yeor-Rouffid Schools 



Rroqrom Purpose 

To relieve overcrowding 
without educQtional 
disadvantage to the Year- 
Round Schcx)l students or 
adverse reactions by their 
parents • 



Evoluotion Questions 

Overcrowding 

I. How successful have participating 
schools been in relieving 
overcrowding? 

Program Process 



2. What are the opinions of teachers 
and administrators about the 
advantages and disadvantages of 
Year-Round Schools? 



3, What are the instructional 

practices at Year-Round Schools? 



^, What are the attitudes of parents 
of participating students toward 
Year-Round Schools? 



Progrom Outcomes 

5. What progress appears to have been 
made in reducing the harms set 
forth in the Crawford decision? 

a. What are the achievement 
levels of Year-Round Schools 
students? 

b. What are the attitudes and 
behaviors of Year-Round 
Schools students? 



c. What are the post-secondary 
opportunities for Year-Round 
Schools students? 



EKLC 
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Sarnpling 

The original sampling plan developed for the study during 1981-82 
involved ^0 schools selected to represent a range of grade configurations 
and different YRS schedules operating in the Year-Round Schools program. 
Five different grade configurations were involved: K-5, K-6, 6-8, 7-9, and 
9-12. In our 1980-81 study, we also compared the effects of schedule, e.g., 
^5/15, 90/30, but no differences were found in our data analysis. 
Consequently, in 1981-82, we chose to compare schools that had prior YRS 
participation with schools new to the program in 1981-82. The logic of using 
that sampling plan was that it could provide data on administrative changes 
made by LAUSD based open feedback from 1980-81 data. It is ujr plan to 
maintain the same sample during this year's study. However, a schedule change 
was made for the 1982-83 school year involving three elementary schools and 
five junior high schools. Last year's study highlighted the problem caused 
when schools in the same neighborhood differed in schedule. Not only were 
families inconvenienced by multiple patterns of attendance and vacation, but 
schools had difficulty in communication among themselves. For this reason, a 
number of schools were placed on the Concept-Six schedule this year (a 
schedule used exclusively by senior high schools in 1982) so that all schools 
within a region would be on the same schedule. Concept-Six operates to permit 
50% more children than capacity (by alternatively including two of three 
groups in session at a time). Thus, moving to Concept-Six administratively 
allows the most capacity for a given site in the light of available options. 
Figure III-2 presents a picture of the distribution of the 1981-82 sample 
schools by grade configuration and schedule at the start of the 1982-83 study. 

The sampling plan for the 1982-83 study calls for the maintenance 
of the 1981-82 sample. (A detailed description of the selection of the 
original 1981-82 sample is presented in the next section.) 

Selection of Yeor^Round Sehoolt for 1981*82 Studr* During the 
1981-82 ^^chooi year, 90 schools operated on a year-round basis; of these, 
87 were considered for inclusion in this study. ' The schools considered 
differed with respect to grade level configuration, type of schedule, and 

'The three Continuation schools on a YRS schedule were not considered for 
study because of their unique educational purpose. 
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Figure 01-2 
Yaar-Round SctioeU Swnpling Ran 



YRS Prior to Kbw to YHS In 19ai«tt2 

School Sch?A!loJ?t2-t3 Sehodolo im~ta 

l«-.3 45/15 WM Ca^.Sin C-«,t-S., 45/15 W30 C^SJ^tS. C»e^-S.K 



K-5 
K-6 

6- 8 

7- 9 
9-12 



2 

12 

4 



1 
4 



ERIC 



182 



-30- 



recency as a YRS. Five grade level configurations existed during 1981-82: 
K-5, K-6, 6-8, 7-9, nnd 9-12.' Three different schedules existed: 45/15 
(45 days in school, 'l5 days out of school), 90/30 ( 90 days in school, 30 days 
out of school), and Concept-Six (163 days, 390 minutes in length, contrasted 
to 176 days, 360 minutes in length, with the traditional calendar). Concept- 
Six involves three different tracKS and the 45/15 and 90/30 schedules involve 
four separate tracks at each school. Forty-one of the 87 schools were new to 
Ihe YRS program in 1981-82. Thus, a contrast between the two groups was 

planned with respect to length of participation prior to 1981-82 a^d new in 

1981-82. 

The three dimensions above combined to categorize the 87 schools as shown 
in Table lll-l. In addition to the three dimensions shown in this table, a 
fourth dimensio, , grade level configuration during 1980-81 was also necessary 
to specify completely all the relevant variations because eight schools had 
changed grade level configurations since the previous year. Specifically, six 
schools that were configured as K-6 in 1980-81 operated with grades K-5 in 
1981-82, and two schools that had grades 7-9 in 1980-81 operated with grades 
6-8 in 1981-82. Thus, the c-mplete sampling matrix is composed of four 
factors: grade level configuration during 1981-82, grade level configuration 
during 1980-81, length of YRS participation, and type of schedule. 

The final sampling strategy was shaped by two additional considera- 
tions. First, our analyses in 1980-81 indicated that the type of schedule 
did not result in important differences in student performance. Therefore, 
we decided to relax this dimension for sampling purposes by selecting 
schools with the predominant schedule when grade level configuration was 
held constant. Second, the year-round elementary schools included ^in the 
PHBAO testing sample were eliminated from inclusion in our sample. A total 



' Modified Concept-Six schedules and one experimental 60/20 
schedule ware not used as schedule types for stratification. 

^An evaluation of the PHBAO (predominantly Hispanic, Black, As; an, and 

Other non-Anglo) programs was being conducted concurrently during this period. 
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of sixteen schools fell into this category. These considerations led to q 
sampling strategy which eliminated two cells from the matrix. These cells are 
indicated in Table IIU!. 

The total sample of schools was thus allocated to the remaining 
sampling cells. The allocation was designed to achieve uniform sample 
representation within the constraints of the population distribution. The 
sample size for each cell has been indicated in Table |ll-l , Selection 
of schools within a cell was accomplished through a random sampling 
procedure within each defined category. 

Selection of Yeor-Round Schools for 1982-83 Study. As mentioned 
previously, it was decided to include the same schools for the 1981-82 study 
in the 1982-83 study. This decision assured continuity and comparability of 
data over the two-year period. The resultant sample of schools were 
distributed across geographical areas and inclu\ied all currently operating 
grade level configurations and schedules. (Table III-2 presents a complete 
breakdown of the sample schools in terms of the sampling dimensions,) How- 
ever, as was noted above, eight schools were operating on a new schedule 
during the 1982-83 year. This change was not viewed as critical to the 
planned analyses, as this type of schedule was found not to influence the 
outcome areas addressed by this study. 

Selection of Respondents Within Yeor-Round Schools. We identified 
five types of respondents that were needed to provide the informction 
implied by our evaluation questions: principals, YRS coordinators, 
teachers, students, and parents. 

The Team plans to include the principal and the YRS coordinator at each 
sampled school as respondents. However, a sampling of teachers, students, and 
parents will be used as respondents because of time and resource constraints. 
All students and teachers within four grades (5, 6, 8, and 12) are targeted 
for study because they provide variation over grade levels and representation 
of the ending grade of the most prevalent grade level configurations. A 
separate section describes the parent selection procedure. 
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Table 

1981-82 Year-Round Schools Sarrpling Plan 



YRS Prior to 1981 (N = A6) 



Nbw to YRS in 1931-82 (N =. Al) 



Schedule 1961-82 



Schedule 1981-82 



Total 45/15 Schools 90/30 Schools 45/15 Schools 90/30 Schools 

ion h4mrf)er hAjmber hijmber Nuniier Nun*er Nurtar Number Number NkinAer 

of Schools of Schools In Sample of Schools in Bangle of Schools in Sample of Schools in Sanfile 



Concept 6 
t^4jrri)er NMri»er 
of Schools in Sainple 



(N = 21) (17) 9 
(N = 52) (20) 5 

(N = 5) 



(3)» 



(5) 



(D* 

(29) 



0 
12 



(3) 



(N = 5) 
(N = d) 



37 



(1) 



14 



30 



12 



(A) 



(4) 



nd elementary schools included in PHBAO testing sample, therefore not included in this sample. 
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Table III-2 

1982-8} Year-Round Schooli Sany ling Plan 



VRS Prior to 1981 (N=A6) l^w to YRS In 1981.82 (N = ^l) 

Schedule 19a? -8) Schedule 1982-83 



School Total «/15 Schooli 90/30 School. 45/15 Schooli 90/30 Schooli Cmcept 6 Cmcept 6 

Conlig. I^nber ^kJmb«r ^iJmbflr Mumber Number f4imber f^Jinber Ujfnber Nunier Number Mjmber Number Number 
1981.82 of School! of Schooli In Saoiple of Schooli in Sample of Schooli in Sample of Schooli In Sanf le of Schooli In Senile of Schooli in Sanp le 



K-i (N = 2l) (H) 6 


(3)» 


0 


(!)• 


0 


(2) 


2 


(1) 


1 


K-b [H-.n] (20) 5 






(29) 


12 (3) 0 










U (NO) 


(5) 


1 








k 






?.9 ' (N = J) 


(1) 


1 




' (3) 3 


(1) 


1 






1. 9-12 (N = 4) 

w ■ — 










(4) 


k 






1 Total 34 U 


9 


2 


30 


12 6 3 


7 


11 


1 


1 


•Year-Round elementary schools included 


in PHOAO testing sample 


, therefore not included in thii tampie. 
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Instrumentotion 

Specification for instrumentation were guided by the evaluation issues - 
developed and presented earlier in Figure lll-l and by instrumentation 
specifications developed for the 1981-82 study. Each issue was examined by 
the Team and the variables, measures, and data sources required to address 
each issue were refined as appropriate. The result of this process is 
summarized in Table III-3. 

These specifications require a number of instruments as listed below: 

Abstracts (enrollment and school capacity data) 
Site Administrator Questionnaire 
Teacher Questionnaire 

Student Post-Seccndary Expectation Questionnaire 
Published Measures for Students 

- Comprehensive Tests of Basic Skills (CTBS) 

- Survey of Essential Skills (SES) 

- District Competency Tests 

- School Attitude Measure (SAM) 

Descriptions of these measures are presented in the report of the 1981-82 
findings. Revisions will be made on the site administrator and teacher 
questionnaires to include questions more directly related to curriculum and 
instructional practices in YRS. The remaining items will not be altered 
unless specific minor wording changes are necessary. This consistency is 
desired so that the data may be comparable from year to year. 

Sub^atudy Inst rumentot ion • Consistent with our plan to intensify our 
evaluation during this year, Sub-study A will focus on classroom observations 
and interviews of school administrators and teachers about their current 
instructional practices. 

The intent of the study is to determine whether YRS is inadvertently 
affecting curricular and instructional continuity and effectiveness. These 
instruments will address variables associated with studies of effective 
schools. The final draft of the observation schedule will be submitted to 
LAUSD for review prior to instituting observer training. 
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Table IIU3 
Instrumentation Specif Icatlonss YRS 



Evaluation Oiestlons 

Overcrowding 

1. How successful have 
participating schools 
been in relieving 
overcrowding? 

Program Process 

2. Whot are the opinions of 
teachers and admin- 
istrators about the 
advantages and disadvan- 
tages of Year-Round 
Schools? 



3. What instructional 
practices are used in 
Year-Round Schools 
(sub-study)? 



What are the attitudes 
of parents of partici- 
pating students toward 
Year-Round Schools 
(sub-study)? 

Program Oitconnes 

5. What progress appears to 
have been made in reduc- 
ing harms set forth in 
the Crawford decision? 
5a. What are the achieve- 
ment levels of YRS 
students? 

5b. What are the attitudes 
and behaviors of YRS 
students toward school? 



5c. What are the post- 
secondary opportuni- 
ties for YRS stu- 
dents? 



Variables 



School capacity 
Enrollment 



Preferences for 
different schedules 
(e .g . , Sept .-June , 
45/15, 90/30) 

Opinions about 
YRS features 

Perceptions of YRS 
impact on profes- 
sional and personal 
responsibilities 

School climate 

Parental involvement 

School and class- 
room level indi- 
cators (leadership 
standards, direct 
instruction, cur- 
riculum, moraie) 

YRS parents' 
attitudes 



Reading achievement 
Math achievement 



Attitudes toward 
school 
Vandalism 
Absenteeism 
Discipline 

College entrance 
qualifications 
College plans 
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Data Source 



District 
records 



Teachers 
Principals 
YRS Coor- 
dinators 



Teachers 
Principals 



YRS parents 
of sampled 
students 



Students 



Students 

District 
records 



12th grade 
students 



Measurement 
Methods 



Roster 



Survey 



Observation 
Interview 
Inventory 
Question- 
naires 



Survey 



Achievment 
tests 



Self-report 
measures 
Rosters 



Self-report 



EKLC 



A second effort, Sub-study B, will be conducted in connection with 
developing a better understanding of parental attitudes. It is anticipated 
that an interview schedule for parents and students will be developed and 
reviewed by LAUSD prior to its use. 

Data Collection 

Data collection will be managed by LAUSD Research and Evaluation Branch 
staff for all aspects of the study. (See Table 111-^.) In those two cases, 
data will be collected by identified university personnel under ihe general 
supervision of the Evaluation Planning Team. LAUSD staff will assist in 
attaining access to necessary schools. A detailed plan for data collection 
will be submitted by the coordinators of the sub-studies for review by LAUSD. 
It is anticipated, however, that target grade levels will be the focus of these 
studies. In Sub-study A, for elementary schools, two classrooms at each 
school's ending grade (either 5 or 6) will be observed for reading and math 
instruction. At the junior high level, at eighth grade, two math and two 
English/reading classes will be observed at each school. The same plan will be 
used to observe the twelfth grade at the selected schools. 
Data collection will involve the following tasks: 
. completion of abstract forms 

start-up tasks involving notification of sample and preparation 
for data collecting 

. distribution, collection, and quality control of Site 

Administrator, Teacher, and Student Post-Secondary Expectation 
Questionnaires 

completion of observations at each sample school for each 
specified setting on two separate days 

. distribution, training, collection, and quality control of the 
School Attitude Measure and the Student Post-Secondary 
Expectation Questionnaire 

collection of school-level (by grade) summaries of CTBS 
SES scores and competency test results 
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Toble III-4 
1982-83 Oato Collection Schedule for 
Yeotr -Round SchooKt 



Tfanelir^ 

Task i>8C« Jm. Feb« Morch April Moy June 



Complete abstracts of 

archival data Dec , 



Jan , 



May-June 



Prepare introductory 
letters to region 
superintendents Dec . 

Order SAM nnaterials Dec , 

Prepare mailing labels 
and other ancillary data 
collection materials Dec, 

Send introductory letters 
to region superiniendents 
and F>rincipa!s of 
sampie schools Jon , 



Distribute and collect Site 
Administrator, and Teacher 
Questionnaires 

Administer SAM and Post- 
Secondary Expectation 
Questionnaire 

Maintain quality control and 
prepare questionnaires 
for key punching 

Collect District 
summaries of 
achievement data 



Mid-Feb. 
thru March 

Feb.- March 



April 



April 



May-June 



EKLC 
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Analysis 

The analyses of information will produce summary indicators of the degree 
to which the YRS program processes are successfully operating. Additionally, 
the outcome data will be analyzed for indications that progress has been made 
in reducing the harms identified in the Crawford decision. Separate but 
comparable analyses will be conducted for each of the outcome measures. 

The nature of the analyses will be descriptive, with heavy reliance on 
frequencies, cross-tabulations, and measures of central tendency, and 
dispersion. Measures of association, such as correlation, will be used to help 
identify factors that are related to program success. We will be using school 
level data in most cases. Where appropriate, comparisons using techniques 
such as t-tests or analysis of variance will be used to contrast data on 
various program features. 

A perplexing issue throughout the study has been the identification of 
comparison groups to assess YRS progress. In the oast years, comparisons 
internal to the YRS program hove been made , involving contrasting process 
and outcome data from schools new or with prior YRS experience. For outcome 
data, however, we intend to employ daia from carefully matched non-YRS. These 
analyses should provide indications more -sensitive than overall District 
averages or even geographic region averages. The problem with this approach, 
However, may be that the matching process is inexact. Only a limited number 
of variables could be used for mntching purposes. We have selected school 
size, demographic information regarding ethnic composition, mobility, and 
socioeconomic status, and geography. Clearly other variables could be 
considered, such as average number of years of teaching experience for staff. 
Yet, each additional variable reduces the likelihood oi; finding a match, and 
no complete set of matching variables could be used in any case. Thus, any 
effort at matching will be incomplete, and schools similar on known victors 
may differ widely on unmatched variables, e.g^., length of tenure of principal. 
Thus, any inferences from these data must be cautiously made and 
serve to provide, at best, support for hypotheses developed from other data 
sources. The primary purpose of the matched group is to permit comparisons to 
be made in a sub-study of instructional process. It is for this reason that 
we are not planning to summarize data from non-year-round schools. Rather, on 




-39^ 



193 



a pair-by-pair of matched, schools basis, we will examine the patterns to 
determine if there are any consistencies. For achievement and attitude data, 
we will have available, SES, CT3S and SAM 1982-83 results as well as 
scores from prior years. For post-secondary opportunities, comparison of data 
will be made only across time. 

Because the potential for misunderstanding complex and quantitative 
information is high, we will plan to use clear, concise language, and simple 
graphic presentations to assist in understanding. Our conclusions, in any 
case, will be made on a probabilistic basis. The Team believes that careful 
explanation and clear presentation will serve the audiences for this report. 
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